-- Logs begin at Thu 2021-10-28 07:55:31 UTC, end at Thu 2021-10-28 09:08:39 UTC. -- Oct 28 08:26:28.515124 dv-cinder-815659-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 08:26:28.522725 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 08:26:28 2021] *** Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: nodename: dv-cinder-815659-2-iscsi Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: machine: x86_64 Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: clock source: unix Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: pcre jit disabled Oct 28 08:26:28.524735 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: detected number of CPU cores: 4 Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: current working directory: / Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: detected binary path: /usr/bin/uwsgi-core Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: your processes number limit is 47680 Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: your memory page size is 4096 bytes Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: detected max file descriptor number: 2048 Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: lock engine: pthread robust mutexes Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: thunder lock: enabled Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 08:26:28.525427 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 08:26:28.573896 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: Python main interpreter initialized at 0x557e743159c0 Oct 28 08:26:28.573896 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: python threads support enabled Oct 28 08:26:28.573896 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: your server socket listen backlog is limited to 100 connections Oct 28 08:26:28.573896 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: your mercy for graceful operations on workers is 90 seconds Oct 28 08:26:28.574290 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 08:26:28.574376 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: *** Operational MODE: preforking *** Oct 28 08:26:28.574704 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: *** uWSGI is running in multiple interpreter mode *** Oct 28 08:26:28.574704 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: spawned uWSGI master process (pid: 79623) Oct 28 08:26:28.574909 dv-cinder-815659-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 28 08:26:28.575513 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: spawned uWSGI worker 1 (pid: 79639, cores: 1) Oct 28 08:26:28.575874 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: spawned uWSGI worker 2 (pid: 79640, cores: 1) Oct 28 08:26:28.577285 dv-cinder-815659-2-iscsi devstack@keystone.service[79623]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 08:26:33.838351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:26:33.838351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: from cryptography.utils import int_from_bytes Oct 28 08:26:33.839264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:26:33.839264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: from cryptography.utils import int_from_bytes Oct 28 08:26:33.839715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:26:33.839715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: from cryptography.utils import int_from_bytes Oct 28 08:26:33.839855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 08:26:33.839855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: from cryptography.utils import int_from_bytes Oct 28 08:26:33.890186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:26:33.890399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:26:33.890566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] command line args: [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:26:33.890681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 08:26:33.890841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:26:33.890946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 08:26:33.891026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ================================================================================ {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:26:33.891106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] command line args: [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 08:26:33.891298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] admin_token = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.891397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 08:26:33.891523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ================================================================================ {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 08:26:33.891665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] config_dir = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.891783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] admin_token = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] config_dir = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] config_source = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] config_source = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] debug = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] debug = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.892778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.893993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_config_append = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_config_append = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_dir = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_dir = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_file = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.894939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_file = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.895899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.896956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.897892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] publish_errors = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.898971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] publish_errors = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.899948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] standard_threads = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] standard_threads = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.900984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] use_journal = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] use_journal = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] use_json = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] use_json = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] use_stderr = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] use_stderr = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.901938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] use_syslog = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.902050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] use_syslog = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.902166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.902279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 08:26:33.902397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.902540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.902658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.902770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.902888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.903821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.904953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.905937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.906785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.907433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.907594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.907980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.908442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.908565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.908692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.908807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.908919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.909905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.910744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.911975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.912960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.913979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.914912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.915946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.916817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.917990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.918935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.919959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.920957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.921993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.922116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.922231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.922328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.922423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.922615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.923689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.924933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.external = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.password = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.925964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] auth.token = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.926903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.927940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.external = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.928908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.password = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] auth.token = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.929873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.930945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.931986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.932953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.933954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.934967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.935947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.936908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.937887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.938049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.938130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.938416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.938736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.939931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.940905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.941850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.942039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.942239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.942307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.942373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.944989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.945996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946575 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.946962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.947984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.948994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.949942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.950922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.951935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.952989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.953955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.954963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.955946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.956983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.957973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.958943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] role.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] role.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.959893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.960887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.961846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] role.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.962997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] role.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.963935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.964995 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.965959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.966891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.967871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.968853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.969007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.969093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.969240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.969320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.969990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.970084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.970339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.970630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.970749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.970874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.971868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.972845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.connection = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.973951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.974941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.975994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.976937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.connection = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.977098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.977197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.977268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79640) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:26:33.977379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.977618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.977860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.978099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.978339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.978598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.978837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.979084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.979348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.979594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.979831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.980082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.980320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.980565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.980804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.981046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.981283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 08:26:33.981452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 08:26:34.008540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.008769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.008996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.010081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.010312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.010559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.017715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.019582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.046320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.046585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.051339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.051571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.105464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.107086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.250190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.250459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.251747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.251988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.316787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.316999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.317965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.318125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.318342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.343441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.343610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.343700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.343821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.343909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.344045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.344130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.344267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.344358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.345100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.345317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.345762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.345906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.346099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.356357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.356925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.370890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79640) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.371762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 08:26:34.388802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.389015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 08:26:34.389111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.389223 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 08:26:34.389347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.389553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 08:26:34.389646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.389765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 08:26:34.389846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.390852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.402069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.402863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.402980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.403060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.403134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.403207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.403279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.403416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.411714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.412704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.414936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.415217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.415697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.415795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.415872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.415975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.416886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.417966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.418234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.418521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.444339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.445943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.446029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.446224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.447576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.447856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.451558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.451839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.452133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.453128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.453403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.453706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.460322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.460607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.461166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.461444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.465029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.465315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.465603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.465840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.465924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.466861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.467095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.467202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.467376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.467661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.467927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.486914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.487190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.488895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.489170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.492421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.493779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.496095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.496396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.497336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.497645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.501473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.503102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.505034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.506631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.508605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.508904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.509197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.509596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.510150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.510242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.510442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.510544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.510758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.511150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.511433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.511724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.529358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.529637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.529905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.530178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.530903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.531185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.531450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.531709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.538718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.540378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.540633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.540717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.542287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.542584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.543662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.543940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.544218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.544503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.544779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.545553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.545840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.546120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.546406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.546773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.558627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.558908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.559197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.559478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.559760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.560044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.560319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.561082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.561362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.561640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.561918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.562204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.562867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.562867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.577799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.581253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.582351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.585634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.585802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.587246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.588845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.589053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.589150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.589393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.590628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.592220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.592492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.592779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.597303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.598854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.601080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.601996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.602291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.602603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.602689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.602885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.605802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.606096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.606375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.606670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.612401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.612940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.613221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.616807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.617093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.617376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.621046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79640) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.621328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.621608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.621887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.622166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.622443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.622754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.623024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.623293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.623576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.623855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.624122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.624395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.624655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79640) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.625154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 08:26:34.625432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.625813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.626527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.626813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.627094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.627380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.627646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.627915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.628189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.628457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.628726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.629003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.629259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 08:26:34.662567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e743159c0 pid: 79640 (default app) Oct 28 08:26:34.665833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fa84-1017-4cd2-a987-a596275af266 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:34.666122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fa84-1017-4cd2-a987-a596275af266 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:34.666402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fa84-1017-4cd2-a987-a596275af266 None None] PATH_INFO: `/v3` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:34.667839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e743159c0 pid: 79639 (default app) Oct 28 08:26:34.670682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Thu Oct 28 08:26:34 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:42.598437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:42.598999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:42.598999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:42.604132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:42 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:42.611552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:42.612312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:42.612312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:42.645425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG oslo_db.sqlalchemy.engines [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79640) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:26:42.841970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG passlib.handlers.bcrypt [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79640) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 08:26:42.842397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG passlib.handlers.bcrypt [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79640) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 08:26:42.899554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:42.901129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:43.042548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:43.186992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:43.221404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG oslo_db.sqlalchemy.engines [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 08:26:43.352107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7f68d-cddc-4606-bebc-eb41707d4d5b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:43.356439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:43.357114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:43.357399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:43.357674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:43.367715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:43.419950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.common.rbac_enforcer.enforcer [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 08:26:43.420294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ddc26-09a7-4268-8431-da6488481f6a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:43.431583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:26:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:26:43.440377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:43.455063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e0471-d816-46f0-9e2c-b7555585288a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:43.459917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:43.461039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:43.461328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:43.461605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:43.463168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff2c85101aec4012bf80ddd35cbbddef)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:43.517101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.common.rbac_enforcer.enforcer [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 08:26:43.517448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fd3d6-09e9-4424-a941-5a70506c8711 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:43.522361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:26:43 2021] GET /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:45.817718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5926e-8235-4c62-8bb3-19619e420745 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:45.818304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5926e-8235-4c62-8bb3-19619e420745 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:45.818304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5926e-8235-4c62-8bb3-19619e420745 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:45.823108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:45 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:26:45.830321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:45.830814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:45.830900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:45.849875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:45.851457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:45.859316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:45.883629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5926e-8235-4c62-8bb3-19619e420745 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:45.896901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5926e-8235-4c62-8bb3-19619e420745 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:45.901148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:45.901798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:45.902081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:45.902355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:45.911397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:45.913192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1175fa-965b-4431-8ca9-670a502f5e30 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:45.922035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:26:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:26:45.929051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:45.938805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76605132-13ea-4f20-8708-f99aa210c952 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:45.943472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:45.944329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:45.944610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:45.944885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:45.946279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:45.948152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3e54c-30e5-4bae-b99b-c4e09e2de061 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:45.949735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:26:45 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:48.312978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28d7b-f222-4403-afea-e589c5fe680e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.313605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28d7b-f222-4403-afea-e589c5fe680e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.313605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd28d7b-f222-4403-afea-e589c5fe680e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.315630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:48.322051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae97b7-aadc-404b-8791-f56d8c5e1513 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.322645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae97b7-aadc-404b-8791-f56d8c5e1513 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.322795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae97b7-aadc-404b-8791-f56d8c5e1513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.341241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5aae97b7-aadc-404b-8791-f56d8c5e1513 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:48.342449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5aae97b7-aadc-404b-8791-f56d8c5e1513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:48.351410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 6/11] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:48.361582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd870-9e7a-44d0-aceb-e0f0c4031206 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.361865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd870-9e7a-44d0-aceb-e0f0c4031206 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.362142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd870-9e7a-44d0-aceb-e0f0c4031206 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.364349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 6/12] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:26:48.369994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.370281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.370599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.376347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bd870-9e7a-44d0-aceb-e0f0c4031206 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.388116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bd870-9e7a-44d0-aceb-e0f0c4031206 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.388515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:48.389728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:48.392926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.393701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.393981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.394248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.397983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:48.413765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:26:48.420923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:26:48.421738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.422207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:26:48.428857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.431476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854acfc-2461-4c53-afe9-906d8a4e7f3c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.435901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.436551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.436835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.437112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.440413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456144d-f5d9-4311-8928-577f944b3902 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.444881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.445547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.445828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.446103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.446189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.446897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:48.447204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.448185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.448954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:48.448954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:48.448954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:48.449870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.458219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 8/15] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:26:48.464676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 8/16] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:26:48.464816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.471974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.474642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21c69-4c9a-4064-abaa-2606eab8f0b5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.479165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.479947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.480230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.480507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.481465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85adee-e107-42f3-8c10-d242dd00f3c3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.481731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.483498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.485148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:26:48.486178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.487075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.487353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.487878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.489656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.491577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.493516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:26:48.499702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.511035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f77e9-1395-48ef-b40c-5d6495cec8a1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.517014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.517831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.518108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.518381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.519787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.521519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ba21-5888-4bd2-b9d6-5589180376e0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.523476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:48.530010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:48.541207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472524be-caaf-41ae-b974-3307cbbec62e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:48.546247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:48.546974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:48.547329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:48.547602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:48.548667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.domain.id=default, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:48.548987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:48.550061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:48.550061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:48.550061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:48.551324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe054ea-eb99-4433-991c-29f8b2d17094 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:48.561705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 10/20] 10.222.0.76 () {56 vars in 1343 bytes} [Thu Oct 28 08:26:48 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.domain.id=default&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:51.193273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710d65-7281-4225-9744-ef8a4be9a9a7 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.193816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710d65-7281-4225-9744-ef8a4be9a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.193816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07710d65-7281-4225-9744-ef8a4be9a9a7 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.196380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 11/21] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:51.202490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.203712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.204198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.252013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG passlib.handlers.bcrypt [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79639) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 08:26:51.252453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG passlib.handlers.bcrypt [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79639) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 08:26:51.303208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:51.305687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:51.340854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 11/22] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:51.379067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07710d65-7281-4225-9744-ef8a4be9a9a7 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.396357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07710d65-7281-4225-9744-ef8a4be9a9a7 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.401404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.402557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.403067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.403538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.416798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.419062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.444725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-f017dccd-5c5f-4a28-9021-252531ef27c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:26:51.446357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 12/23] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:26:51.453474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.459947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbeacb-1033-4511-a633-0c187c9380d1 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.460560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbeacb-1033-4511-a633-0c187c9380d1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.461038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbeacb-1033-4511-a633-0c187c9380d1 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.463380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:51.465067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ac6f1-49b0-4be8-b885-b2c3ab135e56 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.476146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.476763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.477243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.477822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.478902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.479186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.479459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.480372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:51.480701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.481759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:51.481759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:51.481759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:51.482746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.506677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:51.508336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:51.510819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 12/25] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:51.519316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.526601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 14/26] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:51.531998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdac8a-6a33-45da-aac4-d72fea8141af admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.542887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.543582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.543865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.544139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.545085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.546105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:51.546105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:51.546105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:51.548134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.633204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.653559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7d88-c706-4744-abb1-3cacd5f1666d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.674438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.675418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.675707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.675986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.715754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:26:51.723636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:26:51.731107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 15/27] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:26:51.731656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 13/28] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:26:51 2021] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:26:51.745281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.760151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8551703-5920-46f7-b6fa-f3b0384d80d8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.847369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.848060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.848345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.848621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.849410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:51.849715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.851526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:51.851526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:26:51.851526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:26:51.852459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.876261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 16/29] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:51.883447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.921123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615bde9-d4cb-44c2-b819-a96ac5c48d20 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.930594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.932203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.932728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.933258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.936301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.949105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.953000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 14/30] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:51.958918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:51.976700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa8ac-cdf5-496b-8689-17334333ea6c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:51.990243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:51.991103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:51.991390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:51.991668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:51.995420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:51.997281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95269e-f527-4011-afc2-e19dcddd6a30 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:51.999116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 17/31] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:52.005749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:52.022216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f11f5-1212-48d8-9d7c-205f04fc820a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:52.032151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:52.034925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.035442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.035947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] PATH_INFO: `/v3/domains/default/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.040348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=caea61e355e24e9880292252c98a910d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:52.046617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:52.046617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:52.046617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:52.052941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689296d5-1f62-4bd2-bba2-4789fd069d75 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:52.091146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 15/32] 10.222.0.76 () {58 vars in 1382 bytes} [Thu Oct 28 08:26:52 2021] PUT /identity/v3/domains/default/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:26:52.205830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95530d84-ed96-4a59-8572-b4ee197974e4 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.206555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95530d84-ed96-4a59-8572-b4ee197974e4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.206555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95530d84-ed96-4a59-8572-b4ee197974e4 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.208676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 18/33] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:52.216549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14c1c9-3edf-42b4-b40d-f48259239f6b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.217284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14c1c9-3edf-42b4-b40d-f48259239f6b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.217531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14c1c9-3edf-42b4-b40d-f48259239f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.257130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cf14c1c9-3edf-42b4-b40d-f48259239f6b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:52.259365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cf14c1c9-3edf-42b4-b40d-f48259239f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:52.371357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 16/34] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:52.424738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95530d84-ed96-4a59-8572-b4ee197974e4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:52.440788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95530d84-ed96-4a59-8572-b4ee197974e4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:52.445584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:52.446309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.446663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.446938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.447769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:52.448856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:52.448856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:26:52.448856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:26:52.449771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:52.562306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801f7c-2caa-40a1-ad66-6249f9b0af1b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.562700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801f7c-2caa-40a1-ad66-6249f9b0af1b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.562975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801f7c-2caa-40a1-ad66-6249f9b0af1b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.566332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 17/35] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:26:52.571740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7122d-5145-4b43-9b9c-7b7c88c24853 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.572048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7122d-5145-4b43-9b9c-7b7c88c24853 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.572318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7122d-5145-4b43-9b9c-7b7c88c24853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.601606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fef7122d-5145-4b43-9b9c-7b7c88c24853 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:52.602914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fef7122d-5145-4b43-9b9c-7b7c88c24853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:52.603263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 19/36] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:26:52 2021] POST /identity/v3/roles => generated 219 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:26:52.614921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 18/37] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:52.642095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:52.654156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caac16-7266-4aeb-84dc-e442a0f48652 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:52.662140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:52.662901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:52.663184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:52.663460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:52.664256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:52.666122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfedd2d-5870-4784-a374-f4d3d33fcd00 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:52.686761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 20/38] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:26:52 2021] POST /identity/v3/roles => generated 225 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:26:53.170743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aec57-afe6-48cc-a636-e15fd4dd0045 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.171086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aec57-afe6-48cc-a636-e15fd4dd0045 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.171319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aec57-afe6-48cc-a636-e15fd4dd0045 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.173668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 19/39] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:53.180172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.180543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.180745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.200071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:53.201646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:53.210983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 21/40] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:53.234859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aec57-afe6-48cc-a636-e15fd4dd0045 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:53.252008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588aec57-afe6-48cc-a636-e15fd4dd0045 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:53.260297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:53.261711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.262233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.262799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.265057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:53.269121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e685e-876e-405a-a05b-e9729ee31f0d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:53.274534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 20/41] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:53.288546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:53.298723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553fcc8-58eb-4f43-8e12-9da41d43811b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:53.303552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:53.304331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.304611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.304890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.305737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:53.307091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:53.307091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:26:53.307091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:26:53.308097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f483e-c16c-4972-b4dc-3dbb0854ad6b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.308394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f483e-c16c-4972-b4dc-3dbb0854ad6b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.308492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:53.308683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f483e-c16c-4972-b4dc-3dbb0854ad6b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.310664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 21/42] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:53.317194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6e29-72bc-4fc1-b8bb-de95c689e056 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.317486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6e29-72bc-4fc1-b8bb-de95c689e056 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.317764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b6e29-72bc-4fc1-b8bb-de95c689e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.337755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fe8b6e29-72bc-4fc1-b8bb-de95c689e056 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:53.339035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fe8b6e29-72bc-4fc1-b8bb-de95c689e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:53.339791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 22/43] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:26:53 2021] POST /identity/v3/projects => generated 312 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:26:53.415161 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 22/44] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:53.440050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:53.450884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00916f7-daf6-4a87-bd43-dbe0ed2ae586 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:53.456822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:53.457526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:53.457821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:53.458108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:53.458970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:53.460659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68ebb0-e0ea-41ec-ab39-ecbb31055699 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:53.477678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 23/45] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:26:53 2021] POST /identity/v3/roles => generated 223 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:26:54.853057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d400d-1a9d-4e73-8089-3b625eaafe26 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:54.853586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d400d-1a9d-4e73-8089-3b625eaafe26 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:54.853860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d400d-1a9d-4e73-8089-3b625eaafe26 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:54.855742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 23/46] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:54.862438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:54.863387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:54.863387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:54.882979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:54.884202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:54.893213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 24/47] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:54.917216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d400d-1a9d-4e73-8089-3b625eaafe26 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:54.930107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d400d-1a9d-4e73-8089-3b625eaafe26 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:54.934439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:54.935278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:54.935559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:54.935833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:54.947673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:26:54.956008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:26:54.957497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 24/48] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:26:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:26:54.963654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:54.974022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f639cbc-026a-4fd9-872d-5c3a68870e01 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:54.978773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:54.979538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:54.979900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:54.980248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:54.981107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:54.981420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:54.983092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:54.992662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 25/49] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:26:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:54.999064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:55.012027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b279-87e5-4fff-9c18-c9b798ae62c2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:55.017452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:55.018340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.018653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.018934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.020194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:55.022055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:55.023729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 25/50] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:26:54 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:55.029906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:55.039818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4602d0f-6c12-4124-85bd-b272baab241f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:55.044285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:55.045080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.045373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.045661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.046911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:55.048719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917c61-2dab-4c15-a50c-1252ad83f9f2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:55.050362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 26/51] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:55.056964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:55.067516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ee1ac-f67a-4386-80a2-3e8a8749a672 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:55.072241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:55.072906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.073200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.073485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.074340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.domain.id=default, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:26:55.074696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:55.076609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaf5d1-b9d7-4ed0-8fb0-b4f36ea194dd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:55.085387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 26/52] 10.222.0.76 () {56 vars in 1343 bytes} [Thu Oct 28 08:26:55 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.domain.id=default&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 530 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:55.681721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507110c-c467-4b0d-b640-65d49a234624 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.682002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507110c-c467-4b0d-b640-65d49a234624 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.682281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507110c-c467-4b0d-b640-65d49a234624 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.684108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 27/53] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:55.691100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.691398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.691678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.709722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:55.710981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:55.718696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 27/54] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:26:55.743368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507110c-c467-4b0d-b640-65d49a234624 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:55.756431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507110c-c467-4b0d-b640-65d49a234624 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:55.760701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:55.761486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.761762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.762044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.763207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:55.764915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ff255-9da8-4410-aebd-afc00986c6db admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:55.767698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 28/55] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:55.773882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:55.783071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c580f1-d4c4-43fb-a751-6f4d96edfdcf None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:55.787644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:55.788305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:55.788592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:55.788873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:55.789628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:55.791607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8d3b1-d22e-4103-8771-f77331c6b970 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:55.818047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 28/56] 10.222.0.76 () {60 vars in 1161 bytes} [Thu Oct 28 08:26:55 2021] POST /identity/v3/projects => generated 298 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:26:58.134284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59827-eb83-4446-8440-be5be1ff9062 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:58.136724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59827-eb83-4446-8440-be5be1ff9062 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:58.136724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59827-eb83-4446-8440-be5be1ff9062 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:58.136724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 29/57] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:26:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:26:58.144003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521965-c42c-4623-877b-085f559c947c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:58.144506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521965-c42c-4623-877b-085f559c947c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:58.144618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521965-c42c-4623-877b-085f559c947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:58.163002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ba521965-c42c-4623-877b-085f559c947c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:26:58.164221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ba521965-c42c-4623-877b-085f559c947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:26:58.221757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 29/58] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:26:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:26:58.248189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59827-eb83-4446-8440-be5be1ff9062 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:58.260967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59827-eb83-4446-8440-be5be1ff9062 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:58.265286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:58.267290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:58.267579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:58.267856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:58.269123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:58.270881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b984a-7a0d-4be4-bbc7-a803e3c9ea94 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:58.272548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 30/59] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:26:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:26:58.278906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521965-c42c-4623-877b-085f559c947c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:26:58.289165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba521965-c42c-4623-877b-085f559c947c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:26:58.293913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:26:58.294716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:26:58.295008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:26:58.295288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:26:58.296041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:26:58.297100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:26:58.297100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:26:58.297100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:26:58.298399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f812a0d-372b-4354-ae41-3190fa32f9fc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:26:58.325539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 30/60] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:26:58 2021] POST /identity/v3/users => generated 275 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:02.224478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1111-0dca-442f-8026-e687b3774853 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.225570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1111-0dca-442f-8026-e687b3774853 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.226061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1111-0dca-442f-8026-e687b3774853 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.228130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 31/61] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:02.236115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.237104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.237850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.263575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:02.265169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:02.273889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 31/62] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:02.311550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1111-0dca-442f-8026-e687b3774853 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.330202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1111-0dca-442f-8026-e687b3774853 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.342043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.343420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.344727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.345991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.367544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:02.375484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:02.377372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 32/63] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:02.383617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.397006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49079ce7-e372-4c2b-b026-1d0f5238ffd8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.402679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.403781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.404404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.405172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.408475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.409377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.412936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781add93-5f50-48a8-b374-7b816ff0ede3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.437237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 32/64] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.444318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.462018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d87188-d493-4275-8c06-5c817990f443 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.472617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.473908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.474678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.475456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.480784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cca-c578-4035-a034-b0b99c432bdb None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.481685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cca-c578-4035-a034-b0b99c432bdb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.482443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4cca-c578-4035-a034-b0b99c432bdb None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.486884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 33/65] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:02.495603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec157-9a09-45fa-a475-e4bf02775eb3 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.496139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec157-9a09-45fa-a475-e4bf02775eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.496571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ec157-9a09-45fa-a475-e4bf02775eb3 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.498867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 34/66] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:02.501274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.502925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c14-b8a6-4051-b704-b837862ff12f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.503382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c14-b8a6-4051-b704-b837862ff12f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.503499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.503908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c14-b8a6-4051-b704-b837862ff12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.505198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 33/67] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.511695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.523856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6e8d-8adc-4238-9e33-3c86254e4edf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.530136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.530680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f6a07c14-b8a6-4051-b704-b837862ff12f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:02.530836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.531836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.532273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.532879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f6a07c14-b8a6-4051-b704-b837862ff12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:02.541498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.543640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.549071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 35/68] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:02.551249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.552124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.552593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.565356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 34/69] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:02.571793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.575274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:02.579958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:02.591577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98f856-56a6-403c-ad39-90f4f9994d65 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.598313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 36/70] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:02.606530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.606732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.606732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.606732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.606732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.608204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.611156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.613353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 35/71] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:02.620479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.621319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a200e24-ae94-46bd-a68d-489dc45c4f44 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.633076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3e94a-7af1-4509-97bd-2f9759f5a45f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.633841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.635050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.635654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.636214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.637807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.638471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.638791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.639072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.639950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.640263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.642123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:02.642123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:02.642123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:02.643395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.651146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 36/72] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=4dd88532ef744ea69be69bfd9975560b => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:02.652011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.653026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:02.662731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:02.663299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228747a-042d-4b95-8b25-91da4ace1e38 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.664885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 37/73] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:02.671428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.679610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.681109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.681910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.682745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.694986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63f091-7a79-45b7-afae-d52fd5f6aa29 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.702960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:02.708446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.709141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.709431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.709716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.710516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.710833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.712472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.714137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:02.716006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 37/74] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:02.724561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.729567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 38/75] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.737325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff89e-628a-4fe8-b158-0aaea07705cc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.739775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.742360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.743127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.743411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.743691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.744483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.744788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.746481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.756806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98fa1-750c-4ec7-809b-89e893397b45 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.757035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 38/76] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.763526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.770088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.772158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.772749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.773208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.774574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be8b2a-302e-494f-b597-86e352a0fb43 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.775018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.777614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4cf9f-2734-4571-a8ab-e8b87b7171ee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.779399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.780291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.780435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 39/77] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.781078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.782316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.782480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1237-5d5a-45a2-8f7f-fb057b42a882 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.782695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1237-5d5a-45a2-8f7f-fb057b42a882 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.782952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d1237-5d5a-45a2-8f7f-fb057b42a882 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.784758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 40/78] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:02.785779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.789111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a227b0c-f615-43cf-a3ee-45bbc0807163 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.790517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1237-5d5a-45a2-8f7f-fb057b42a882 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.791861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 39/79] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:02.798635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.798635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.798635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.811960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d1237-5d5a-45a2-8f7f-fb057b42a882 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.817303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.817631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:02.818465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.818859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.819323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:02.819557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.830475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.832782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.834638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 40/80] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:02.835663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.845528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 41/81] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:02.851486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c8de1-a421-4220-a400-7387d3ca1640 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.854835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.855999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.856681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.856969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.857253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.866691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.868416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.872370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce217-f041-453f-8858-75538a837fbf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.879552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 41/82] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:02.880305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.880495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.881193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.881478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.881757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.883132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.885325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.891245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1a862-6ff2-4a15-bd00-b0ccf3b26d8c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.894710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 42/83] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:02.896289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.897603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.900180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.900180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.900180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.900765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.902479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.904495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 42/84] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.905815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063c7d5-0d15-4c6c-912c-f8e4a5d6a1ba admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.909628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.918535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.919397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.919601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.919881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.921219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.923463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.924335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef704-cb78-4127-ac4a-8a491a74997f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.925517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 43/85] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.926170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.935416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.936127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.936410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.936687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.938201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.938807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.941370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.944142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5d7e-df75-4cee-a54c-080551d44ce9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.948414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 43/86] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:02.949168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:02.950352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.951481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.952059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.952555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.954219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.956848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc99571-f5d1-47b0-924a-a9fea23443b0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:02.976824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47027be-c6a3-46c4-81ce-363a17d07fc3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:02.984927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:02.986176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:02.986856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:02.987735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:02.989781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:02.990385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:02.999223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f32bb-80e4-4703-9929-51578b8d42f0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.011137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 44/87] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:02 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:03.014126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 44/88] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:27:02 2021] POST /identity/v3/projects => generated 302 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:03.139304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3b2-2ec0-4a50-851f-1ca0c7cd5fb7 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.139501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3b2-2ec0-4a50-851f-1ca0c7cd5fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.139807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9c3b2-2ec0-4a50-851f-1ca0c7cd5fb7 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.142712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 45/89] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:03.148813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.149488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.150021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.173930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:03.175766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:03.257217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 45/90] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:03.295111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9c3b2-2ec0-4a50-851f-1ca0c7cd5fb7 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.309937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9c3b2-2ec0-4a50-851f-1ca0c7cd5fb7 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.317123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.318048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.318332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.318665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.332706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:03.340063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:03.341569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 46/91] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:03.350491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.360638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c935c-6b5d-4656-93e1-604ebca9a6f2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.368860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.369922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.370408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.370910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.371902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:03.372659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:03.374597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.384805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 46/92] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:03.391383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.404578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f392cf5-00fd-49e9-b4c4-eda07eaa4ff5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.410877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.412130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.412612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.413093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.414611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:03.417089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.419472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 47/93] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:03.425959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.436982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2a76d-0727-4533-b140-6922c3d0276c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.443327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.444354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.444843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.445375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.455732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:03.457945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.469500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 47/94] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:03.476703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.488129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a135589-0700-418a-902c-016146ffcadf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.494735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.496172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.496748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.497238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] PATH_INFO: `/v3/projects/b73c91080d2644b3a0a5c1e12cbec585` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.498730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] RBAC: Authorizing `identity:get_project(project_id=b73c91080d2644b3a0a5c1e12cbec585)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:03.501307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad264096-6e99-4df3-9201-aafd28a00799 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.503480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 48/95] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/projects/b73c91080d2644b3a0a5c1e12cbec585 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:03.511690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:03.523827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbef5c0-2940-4637-b0f4-71a93ab71956 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:03.537657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:03.538335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:03.538655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:03.538934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:03.539799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=b73c91080d2644b3a0a5c1e12cbec585, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:03.540112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:03.542005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f821b85-3e10-40ef-816c-c0d6f8f1f62c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:03.552026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 48/96] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:03 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=b73c91080d2644b3a0a5c1e12cbec585&role.id=4dd88532ef744ea69be69bfd9975560b => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:05.992043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa310d-b2ed-41e4-b70b-b067eef691d4 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:05.993107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa310d-b2ed-41e4-b70b-b067eef691d4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:05.993607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa310d-b2ed-41e4-b70b-b067eef691d4 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:05.996124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 49/97] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:06.003286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.004245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.004723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.024982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:06.026601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:06.035664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 49/98] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:06.060308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa310d-b2ed-41e4-b70b-b067eef691d4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.083914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa310d-b2ed-41e4-b70b-b067eef691d4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.094881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.095697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.095983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.096261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.123799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:06.131470 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-f643128e-170a-4070-8297-3c3cadfff329 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:06.132755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 50/99] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:06.140067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.140781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001eb35-5347-4182-b2b4-7c7d9745fb38 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.141083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001eb35-5347-4182-b2b4-7c7d9745fb38 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.141368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001eb35-5347-4182-b2b4-7c7d9745fb38 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.143579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 51/100] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:06.149987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b139e-badd-4577-a1b9-dcf24b5bcea9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.150297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b139e-badd-4577-a1b9-dcf24b5bcea9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.150579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b139e-badd-4577-a1b9-dcf24b5bcea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.152859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1891b-a64d-41d0-8dcd-4f7e198057f6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.162643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.163701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.164043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.164389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.165262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:06.165637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.167473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83f4c1-57b6-4052-b03e-ec299c971028 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.182647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 50/101] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.184354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a1af-35d1-447b-9359-59655ee31364 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.184720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a1af-35d1-447b-9359-59655ee31364 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.185067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901a1af-35d1-447b-9359-59655ee31364 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.185950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f81b139e-badd-4577-a1b9-dcf24b5bcea9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:06.194534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 51/102] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:06.194534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901a1af-35d1-447b-9359-59655ee31364 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.196030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f81b139e-badd-4577-a1b9-dcf24b5bcea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:06.207709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901a1af-35d1-447b-9359-59655ee31364 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.214595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 52/103] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:06.216196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.216553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.216903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.217435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.222175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.222826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.223557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.226163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.230698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.242614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:06.243028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 52/104] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.246337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.248956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:06.258859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 53/105] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:06.267083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.270396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18014435-9dbc-47ba-a08d-4d1699d3d1cb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.273183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4687f-c87e-47d9-9f53-b16627eb13c2 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.280140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.281122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.281645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.282536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.283746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.286013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.286875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.287154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.287429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.291595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.293899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 53/106] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:06.305342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.310572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:06.318954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27c67-2d62-4f46-acc4-dbd7164bb93b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.323716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.324627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.324913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.325191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/9eb93d4513e246d396afad35fa7eff4e/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.326781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:06.327300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da7e807d8e4ae2b696b96a98712ae1, user_id=9eb93d4513e246d396afad35fa7eff4e, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.330567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 54/107] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:06.332412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.334978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.352479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f474-a7bd-403f-aa8f-2d8ae0eaba61 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.354071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 54/108] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:06 2021] PUT /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/9eb93d4513e246d396afad35fa7eff4e/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:27:06.355125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.440974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf88e-9b8d-48c1-b10f-22089dd1f54e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.447634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.448955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.449258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.449562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.450334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:06.450671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.452782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.464067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 55/109] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.470538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.470967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.472715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.473503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.474290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.482304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b26d-9bde-411c-b55a-67b4c8eb8b9f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.489680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.490774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.491305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.491593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.494064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.497700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.502029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:06.505239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 56/110] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.508803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.517304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:06.519601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 55/111] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:06.524262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9abd-9625-4c91-8c8e-ce2cb6fd1a93 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.531132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.532431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.532775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.533088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.533364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.534765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.537446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.543936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 57/112] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.551587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.564714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bb9f0-8a6c-47d4-85d7-191f1883674d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.571313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9029-7e8c-4762-9140-aeab0a63381f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.588378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.592754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.594976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.595403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.595838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.597442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:06.598043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.598970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.599292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.599586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/9eb93d4513e246d396afad35fa7eff4e/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.601204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07572bac-4800-4f47-9c49-e5e1b9885637 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.608216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da7e807d8e4ae2b696b96a98712ae1, user_id=9eb93d4513e246d396afad35fa7eff4e, role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.616262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3a474-d1d6-4ce4-85df-fe0612f4d88d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.619969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 56/113] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.628706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f852-26ce-494d-a9cd-2831fd4f196e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.629649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f852-26ce-494d-a9cd-2831fd4f196e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.629795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3f852-26ce-494d-a9cd-2831fd4f196e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.634677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 57/114] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:06 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:06.639713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3f852-26ce-494d-a9cd-2831fd4f196e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.658662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 58/115] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:06 2021] PUT /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/9eb93d4513e246d396afad35fa7eff4e/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:06.661279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ba14-f50b-488b-9f90-91f7afbe4f9b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.661901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ba14-f50b-488b-9f90-91f7afbe4f9b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.662431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060ba14-f50b-488b-9f90-91f7afbe4f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.679818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3f852-26ce-494d-a9cd-2831fd4f196e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.727596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a060ba14-f50b-488b-9f90-91f7afbe4f9b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:06.728882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a060ba14-f50b-488b-9f90-91f7afbe4f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:06.816673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.818107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.818652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.819176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.820910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.823352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc98f-f67a-4586-bdfc-0956e7103846 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.826542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 58/116] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.827895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50105-b1ca-47a6-b589-0f27591cd203 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.829053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50105-b1ca-47a6-b589-0f27591cd203 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.829319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b50105-b1ca-47a6-b589-0f27591cd203 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.832040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 59/117] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:06.838349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b50105-b1ca-47a6-b589-0f27591cd203 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.857417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b50105-b1ca-47a6-b589-0f27591cd203 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.863924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.865011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.865296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.865570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.867169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.867831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 59/118] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:06.870171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.870484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.871092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.871685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.872231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 60/119] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:06.896140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.902570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:06.904620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:06.925828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97926db6-3734-4aa6-a7ce-fe2e21b6164c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.929414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 60/120] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:06.930634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:06.939402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.941729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.942464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.943276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.947248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684253f8-3c81-4526-b70f-a8dc05fa3dc9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:06.947863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da7e807d8e4ae2b696b96a98712ae1, user_id=caea61e355e24e9880292252c98a910d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:06.949683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:06.949683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:06.949683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:06.954672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:06.956770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:06.958352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:06.959028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:06.960702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:06.983820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:06.988625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 61/121] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:06 2021] PUT /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:06.989929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.001423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:07.006724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 61/122] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:07.018525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.036662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e2d7-6f00-4ea6-9804-7914fdcbfe71 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.117942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.119025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.120188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.120640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.121717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:07.122597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.124634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.127306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77487d-6058-4da9-a0a6-9d175a62fd2f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.133817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.135232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.135623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.136110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.137534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 62/123] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:07.142631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.142631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.145223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 62/124] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:07.145417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.153114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.157143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201502e-0442-4bdd-b7d3-be7338a78e6f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.163850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.165059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.165529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.166005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.166895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc7dce-ce6b-4087-8021-783f5c97a2d9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.167787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.170768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.174116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 63/125] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:07 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:07.178588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.178588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.178588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.178588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.178937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.178937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:07.178937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:07.178937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:07.180494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c100bb-4de1-41ae-acca-6e6d474888b8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.181633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.193401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303eb6-4319-4fe2-b1df-7af4a4b18a32 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.198866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.200651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.201173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.201622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] PATH_INFO: `/v3/projects/b73c91080d2644b3a0a5c1e12cbec585` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.203351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] RBAC: Authorizing `identity:get_project(project_id=b73c91080d2644b3a0a5c1e12cbec585)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.206489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.208668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 64/126] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:07 2021] GET /identity/v3/projects/b73c91080d2644b3a0a5c1e12cbec585 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:07.216505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:07.239635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 63/127] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:07 2021] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:07.253201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e786-e151-4662-8ad9-50f9aaf55abe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:07.263517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:07.265302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:07.266978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:07.267520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] PATH_INFO: `/v3/projects/b73c91080d2644b3a0a5c1e12cbec585/users/9eb93d4513e246d396afad35fa7eff4e/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:07.277168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73c91080d2644b3a0a5c1e12cbec585, user_id=9eb93d4513e246d396afad35fa7eff4e, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:07.283784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184db5-1fc7-4230-b17e-5af62b957901 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:07.327738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 65/128] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:07 2021] PUT /identity/v3/projects/b73c91080d2644b3a0a5c1e12cbec585/users/9eb93d4513e246d396afad35fa7eff4e/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:09.447142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8480-3351-4869-a3ca-a4fc64495cda None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.447642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8480-3351-4869-a3ca-a4fc64495cda None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.447642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce8480-3351-4869-a3ca-a4fc64495cda None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.449416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 64/129] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:09.458393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.458908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.459002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.479738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:09.480962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:09.552644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 66/130] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:09.600079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8480-3351-4869-a3ca-a4fc64495cda None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.617972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce8480-3351-4869-a3ca-a4fc64495cda None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.624598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.626459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.626965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.627449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.641977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:09.649484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:09.651035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 65/131] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:09.657854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.672870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0e56-7aeb-4ed0-ae79-9a5adaca73d8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.682691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.683391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.683680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.683961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.684749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:09.685060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:09.686748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:09.702955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 67/132] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:09.710324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.726519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923a214-538b-4a1b-bcbf-44451b50c03a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.738614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.739840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.740320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.740789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.742298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:09.744742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:09.746675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 66/133] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:09.753203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.768312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238159-ad75-4973-9ae1-c6fda65b59d3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.778900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.779582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.779871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.780152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.795279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:09.797655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:09.811567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 68/134] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:09.818547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.832409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7e8d-fbf9-490c-a647-3bec24ab0613 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.842731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.844480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.844992 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.845474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.846942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:09.849251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e413108-1cdf-48a6-bdf0-33eb4296f762 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:09.851222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 67/135] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:09.858105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:09.873294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c7ad5-439f-43d8-b908-19030408586d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:09.879869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:09.880541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:09.880831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:09.881111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:09.881974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:09.882288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:09.884213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd27666-2715-4e10-bdd1-16bf2269309d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:09.895577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 69/136] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:09 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=4dd88532ef744ea69be69bfd9975560b => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:10.879234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6c90-9a01-491e-8853-23fab2665878 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:10.880596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6c90-9a01-491e-8853-23fab2665878 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:10.881374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6c90-9a01-491e-8853-23fab2665878 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:10.884936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 68/137] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:10 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:10.892553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:10.893991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:10.894822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:10.925520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5875b9f-a7e1-4cc5-ac4e-6727c50f4109 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:10.926475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5875b9f-a7e1-4cc5-ac4e-6727c50f4109 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:10.927270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5875b9f-a7e1-4cc5-ac4e-6727c50f4109 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:10.930829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 69/138] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:10.940670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:10.941591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:10.942337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:10.964624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:10.968693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:10.983568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:10.986287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:10.989294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 70/139] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:11.007637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 70/140] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:11.044815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.055726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bc1ce-edaa-411d-9242-add3cc1371b6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.059998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.067229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.068055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.068346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.068624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.075795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aeba4-7453-4cc8-806b-260417c81f88 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.092266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:11.099240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.100076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.100368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.100649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.108041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:11.110114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 71/141] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:11.119470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.127585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:11.133343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0a92-fb72-4f73-ab8a-e5fc01a3c6a6 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.135284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:11.136869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 71/142] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:11.143679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.144191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.144946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.145235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.145570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.146370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:11.146701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.148413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.158535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 72/143] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:11.161305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5023238-abf2-467c-b000-1843f4bfbb0d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.170962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.171428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.172718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.172913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.173196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.173993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:11.174300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.180201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.182435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab204a-d9c2-4b1e-84d7-260c0b293792 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.194000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 72/144] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:11.198428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.199429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.199722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.200002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.201830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.207531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.209615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.211742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 73/145] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:11.220374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.225223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e23f12-cab2-4c73-8de9-9618768edf3f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.233258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a6cab-4d3f-44f1-b03a-d82e83c86f9e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.243288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.244068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.244282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.244540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.244748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.244902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.245129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.245411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.246070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.248345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.250833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 73/146] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:11.256436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.257233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.258346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.274051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7684e-b8b3-48be-95ca-1de912939804 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.279132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 74/147] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:11.287642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.295299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.295977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.296280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.297227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.298358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdab90-4039-434e-84dd-820f0735d766 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.309601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.310607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.310900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.311184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.312699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.315013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.315699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.317151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 75/148] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:11.317518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.324127 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.336360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c007e8-efb2-4da2-a34f-4396ce0bdac3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.337943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 74/149] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:11.345486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.349121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.349806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.350145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.350427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.351389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:11.351707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.353778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.361508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 76/150] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:11.365135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d4d7c-e7b2-4d57-9657-a4eb621292f4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.381478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.382363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.382681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.382966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.387445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.389579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1101d-5c38-4e5a-9c70-28847bbb0b4b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.392009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 75/151] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:11.398620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:11.412194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67d42f-9b76-40ff-b68d-baeb09a96303 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:11.420921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:11.422309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.422674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.423102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.424135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:11.424480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:11.426680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea567f0-a2c9-4e2e-b4c3-15ed9ad8d656 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:11.433888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 77/152] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:11 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:11.981956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420c01-cf73-415a-b982-3d2d3143b372 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:11.982697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420c01-cf73-415a-b982-3d2d3143b372 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:11.982697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420c01-cf73-415a-b982-3d2d3143b372 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:11.984582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 76/153] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:12.001834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aafc04-5a14-47d3-9a4e-55c92b935687 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.002441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aafc04-5a14-47d3-9a4e-55c92b935687 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.002441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aafc04-5a14-47d3-9a4e-55c92b935687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.027673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-52aafc04-5a14-47d3-9a4e-55c92b935687 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:12.028928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-52aafc04-5a14-47d3-9a4e-55c92b935687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:12.038067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 78/154] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:12.084316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420c01-cf73-415a-b982-3d2d3143b372 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.100733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420c01-cf73-415a-b982-3d2d3143b372 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.108658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.109529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.109815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.110062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.127128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:12.127515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec124-fada-45c2-a9ee-5e6977c542f6 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.127808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec124-fada-45c2-a9ee-5e6977c542f6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.128095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec124-fada-45c2-a9ee-5e6977c542f6 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.129897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 79/155] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:12.134576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d7e3516e-01fc-4e0e-ada2-f8cd4f58aa64 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:12.135895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 77/156] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:12.143359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ec124-fada-45c2-a9ee-5e6977c542f6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.143948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.144246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.144818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.167297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:12.168587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:12.172363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ec124-fada-45c2-a9ee-5e6977c542f6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.177674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 78/157] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:12.183204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.183897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.184181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.184456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.185239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:12.185544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.187763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.205860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.206966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 80/158] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:12.215185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.217002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944846e-34dd-4a03-97f1-5484e1ca397a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.223523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.225100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.225685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.225974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.227742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f382-188a-43c0-b17a-4e3efffdb879 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.238718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:12.244315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.245213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.245498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.245779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.246452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:12.250911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 79/159] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:12.257216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.268055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4a25d-98b7-43d1-903d-7760e8a7de65 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.271888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.272675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.273393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.273715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.273997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.274442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.274831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:12.275136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.276349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 81/160] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:12.276794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.284749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.294045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 80/161] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:12.296989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698d839-a226-4632-aa28-bd5920f12b1c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.300869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.304621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.305724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.306264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.306794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.311959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31867d6-7f96-4e61-a40f-a274a59a8ecc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.320616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.322930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.332388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.332388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.332388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.332736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.334020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.336233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.337552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 82/162] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:12.342547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 81/163] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:12.344862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.345156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.355179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba21a-05e0-4ca9-908a-4a01448c9a00 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.365087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.365276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e722a-b06d-4b59-973e-2a57deebd48e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.366468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.367034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.367507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.369040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.371653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.374033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 83/164] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:12.378068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.378834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.379147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.379402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.391251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.403537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.404006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681fa6f-9058-44c6-addb-6bf73e29563a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.410565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.420886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 82/165] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:12.422063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.422919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.423201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.423470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.424336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=eb5e99f6cf364aaba3294c1205dca73a) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:12.424646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.426832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.431682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.440477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751bca0-52d7-4213-9dcf-5fdd726f03fe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.442828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 84/166] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/role_assignments?user.id=eb5e99f6cf364aaba3294c1205dca73a&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=4dd88532ef744ea69be69bfd9975560b => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:12.457890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.458817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.459095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.459370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] PATH_INFO: `/v3/projects/b73c91080d2644b3a0a5c1e12cbec585` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.463527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] RBAC: Authorizing `identity:get_project(project_id=b73c91080d2644b3a0a5c1e12cbec585)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.465662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edfff7-60c2-4742-a45d-ef7c05b22843 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.467555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 83/167] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/projects/b73c91080d2644b3a0a5c1e12cbec585 => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:12.475143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.489168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f219ea-4d2f-48cf-a654-de27ffc6ec8e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.498712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.499434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.500240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.501180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.502104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=b73c91080d2644b3a0a5c1e12cbec585, user.id=9eb93d4513e246d396afad35fa7eff4e) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:12.502416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:12.504365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b9753-704c-4e6d-b09d-00685f510f6f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:12.516021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 85/168] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/role_assignments?user.id=9eb93d4513e246d396afad35fa7eff4e&scope.project.id=b73c91080d2644b3a0a5c1e12cbec585&role.id=4dd88532ef744ea69be69bfd9975560b => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:12.885841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f109cb-313b-4b85-873d-38674f0e2ca5 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.886210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f109cb-313b-4b85-873d-38674f0e2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.886412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f109cb-313b-4b85-873d-38674f0e2ca5 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.888241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 84/169] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:12.895313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.895640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.895863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:12.919122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:12.920433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:12.935065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 86/170] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:12.962309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f109cb-313b-4b85-873d-38674f0e2ca5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:12.977948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f109cb-313b-4b85-873d-38674f0e2ca5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:12.988403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:12.989202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:12.989453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:12.989724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.005331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:13.012352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:13.013912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 85/171] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:13.020328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.029590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652cf69-bc9f-46d7-b04f-bbce458e96b7 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.035674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.036347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.036628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.036902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.037677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:13.037979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.039804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.052899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 87/172] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.059347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.073916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a244284-ab61-4d4b-8749-f3e61e00347f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.080919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.081808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.082064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.082304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.083647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.086072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.088190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 86/173] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.094889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.113893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61aea3-9851-4b92-ae98-a4461a40227c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.118749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.119490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.119785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.120064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.129302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.131212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.146717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 88/174] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:13.148638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.160911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccbf10-b1f2-464c-bfc9-bffd81b5ab40 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.165878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.167026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.167519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.167961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.169354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.171849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b42c7-9806-4d6e-baf9-dcc99843a6dd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.178684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 87/175] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.181083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.190940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293278c-433b-41f8-b5a8-b96a7cd13882 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.195931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.196858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.197343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.197836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.198987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:13.199473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.201626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c33e1-1902-4799-9c47-c93de32a4941 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.209253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 89/176] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:13.478663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d054-13b8-4653-b57f-186b1017f364 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.478953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d054-13b8-4653-b57f-186b1017f364 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.479411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d054-13b8-4653-b57f-186b1017f364 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.481253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 88/177] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:13.488420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.488972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.489446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.508842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:13.510352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:13.519730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 90/178] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:13.545745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d054-13b8-4653-b57f-186b1017f364 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.559546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d054-13b8-4653-b57f-186b1017f364 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.565476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.566573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.567101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.567570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.579852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:13.587669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:13.589704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 89/179] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:13.597824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.608277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e28ae7-47cb-4691-9c75-8b260727dc49 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.614588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.615687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.616189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.616665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.617684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:13.618206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.620249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.630399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 91/180] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.636942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.647914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46346a5f-fe55-4c27-a845-f3145dfb6b91 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.652968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.654096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.654594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.655094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.657083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.659577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.661493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 90/181] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.667707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.678048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bee38b-5830-46e7-bc41-f79742cd238c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.683075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.683972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.684527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.684990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.694286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.696428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.706719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 92/182] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:13.713120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.724064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32dd7a-bfda-4d78-81d4-08f63057d4d9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.728898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.729999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.730537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.731051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.732419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.735136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457ed24-f9ac-4651-9e14-0d1322ec5f1c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.737088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 91/183] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.743802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.748009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df3a78-1a14-44b7-8610-3a3368144baa None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.748323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df3a78-1a14-44b7-8610-3a3368144baa None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.748586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df3a78-1a14-44b7-8610-3a3368144baa None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.751591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 92/184] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:13.754489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d70a-b8fd-40fb-bc92-f9f0f85c0cbc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.757366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.757676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.757932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.759970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.760809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.761257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.761696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.762837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=eb5e99f6cf364aaba3294c1205dca73a) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:13.763355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.766015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.772227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 93/185] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/role_assignments?user.id=eb5e99f6cf364aaba3294c1205dca73a&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.777123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:13.778306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:13.786426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 93/186] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:13.810593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.821715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d6458-d066-4967-b275-25be42e196cc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.826556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.827427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.828392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.828836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.830265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.832203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec66879-f31b-424a-8dfd-a7746b17b163 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.834441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 94/187] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:13.840955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:13.851314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e3fee-8f41-499b-98ca-ca67a6a3fc14 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:13.856201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:13.856939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:13.857273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:13.857559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] PATH_INFO: `/v3/groups` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:13.858302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:13.859960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:13.859960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:13.859960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:13.861263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6de7f-6065-48ee-8480-ddeaa6c3bfae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:13.880724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 94/188] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:27:13 2021] POST /identity/v3/groups => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:15.014146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81bc9a-1e6a-4da6-a2c3-2f72a3a72f3e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.014883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81bc9a-1e6a-4da6-a2c3-2f72a3a72f3e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.014883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81bc9a-1e6a-4da6-a2c3-2f72a3a72f3e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.017897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 95/189] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:15.024541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.025132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.025317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.044044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:15.045536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:15.053994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 95/190] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:15.078178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81bc9a-1e6a-4da6-a2c3-2f72a3a72f3e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.091982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81bc9a-1e6a-4da6-a2c3-2f72a3a72f3e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.097648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.098598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.098886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.099165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.111401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:15.118859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:15.120115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 96/191] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:15.126942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.136540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011d136-824e-41f3-a50a-bb4721f9b5c4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.141608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.142301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.142626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.142906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.143702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:15.144009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.145802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.157002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 96/192] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:15.165278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.177311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1131b-01da-4ee0-a052-619e19e3400f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.181941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.182860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.183146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.183427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.184804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.187283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.189099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 97/193] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:15.195092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.205155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97c56d-9555-431e-9e79-1fd12d16f753 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.210484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.211477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.211796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.212087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.213340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.215501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183f003-77d2-41c2-8eb2-cab77b8c3727 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.217351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 97/194] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:15.224450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.234973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ad41-9399-4f1c-9fbc-8e8b0060ac09 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.239870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.240764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.241047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.241323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/eb5e99f6cf364aaba3294c1205dca73a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.243497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0ee93171e4ccdb458be8889b4d5e9, user_id=eb5e99f6cf364aaba3294c1205dca73a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.246367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02bf2a-8339-4e70-96de-284904648d4b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.261452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 98/195] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:15 2021] PUT /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/eb5e99f6cf364aaba3294c1205dca73a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:15.755143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c140a-1334-4747-afb4-78bb369f73db None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.755497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c140a-1334-4747-afb4-78bb369f73db None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.755700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c140a-1334-4747-afb4-78bb369f73db None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.757528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 98/196] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:15.764834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.765157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.766238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.784707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:15.785922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:15.847157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 99/197] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:15.878326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c140a-1334-4747-afb4-78bb369f73db None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.893968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c140a-1334-4747-afb4-78bb369f73db None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.900412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.901879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.902255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.902837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.920398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:15.928830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:15.930215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 99/198] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:15.938038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.947924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c14b7-74d9-4eeb-8670-7291bd070213 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.953752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.954698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.955035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.955380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.956179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:15.956538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.958562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.967860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 100/199] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:15.974742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:15.986273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b60a3-cfdc-40d8-b819-d35cf15dcd60 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:15.991500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:15.992431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:15.992716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:15.992991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:15.994404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:15.996919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:15.999149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 100/200] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:15 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:16.007752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.018964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548a95f-ecbd-4858-84f5-5e72d2999140 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.023777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.024969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.025255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.025532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.026897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.029149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665dee9-3454-463a-b438-9fc8cfaa6422 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.031049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 101/201] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:16.037586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.048789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326d9c0-a008-4382-a52c-c6a67229afee admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.053679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.054647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.054935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.055211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.057315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0ee93171e4ccdb458be8889b4d5e9, user_id=caea61e355e24e9880292252c98a910d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.060191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5980d6e-4246-42d9-bc32-28070f2443ff admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.075961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 101/202] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:16 2021] PUT /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/caea61e355e24e9880292252c98a910d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:16.280988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097b08-24e3-417e-8d76-1a19cf63cbd7 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.281182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097b08-24e3-417e-8d76-1a19cf63cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.281446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097b08-24e3-417e-8d76-1a19cf63cbd7 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.283374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 102/203] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:16.290098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.290409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.290701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.298378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6fa8c-8c23-4423-a7a4-e5c664492c3f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.298734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6fa8c-8c23-4423-a7a4-e5c664492c3f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.299038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6fa8c-8c23-4423-a7a4-e5c664492c3f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.300804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 103/204] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:16.307207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.307488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.307744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.317230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:16.318446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:16.331389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:16.332598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:16.408088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 104/205] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:16.410300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 102/206] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:16.433469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.435669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.444531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3cf66-8ed9-474c-8e5d-507c67fd4cee None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.445959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d610-2429-4bd8-b731-36cd9bfc0d77 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.449181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.449995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.450274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.450574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.451287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.451797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.452233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.452619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.453059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.454283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.456362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 105/207] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:16.462811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.465511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:16.473799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:16.474334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230ddb-c4cb-4086-b8d0-48814fede035 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.475281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 103/208] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:16.481596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.484993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.485995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.486421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.486899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] PATH_INFO: `/v3/groups` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.488559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.489980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:16.489980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:16.489980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:16.491586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.492976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e48aa-5b6b-480a-aa4a-ef437bde9d46 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.497960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.498687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.499026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.499310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.500274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:16.500679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.502479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.512185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 104/209] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:16.517789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 106/210] 10.222.0.76 () {60 vars in 1155 bytes} [Thu Oct 28 08:27:16 2021] POST /identity/v3/groups => generated 226 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:16.518884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.529385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0275c-bcd3-4b32-a02a-7be988447df0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.535072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.535794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.536080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.536356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.537742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.540111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.542012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 105/211] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:16.549736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.561183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216c5ff-c270-409a-ae5b-c7dd613a8ca8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.566864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.567849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.568136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.568415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.569791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.572041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f97f0-23e2-4702-9ae2-0389d0ff6982 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.574093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 107/212] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:16 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:16.580691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:16.591737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677616-973c-4f05-b879-8f1110079da9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:16.597321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:16.598237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:16.598548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:16.598835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/eb5e99f6cf364aaba3294c1205dca73a/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:16.601205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0ee93171e4ccdb458be8889b4d5e9, user_id=eb5e99f6cf364aaba3294c1205dca73a, role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:16.604165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26f77-6efc-4eb9-a2e0-b6778ef9d3ca admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:16.625700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 106/213] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:16 2021] PUT /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/users/eb5e99f6cf364aaba3294c1205dca73a/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:18.080740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eded1-9b54-4f03-851c-d1f004cef24e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.081252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eded1-9b54-4f03-851c-d1f004cef24e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.081726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eded1-9b54-4f03-851c-d1f004cef24e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.085634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 108/214] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:18 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:18.098691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.099098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.099260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.123084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:18.124362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:18.262727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 107/215] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:18.315940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eded1-9b54-4f03-851c-d1f004cef24e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.348559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eded1-9b54-4f03-851c-d1f004cef24e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.363416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.364943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.365463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.365969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.392701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:18.413536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:18.420102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 109/216] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:18.432384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.456381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ad42-2e6e-44af-9b26-9d7dee717a3b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.473965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.475232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.475747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.476259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.477796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:18.478347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:18.481608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:18.506984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 108/217] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:18.517796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.537189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f02860-5d27-49b2-8337-cde94e36905c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.547109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.548012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.548298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.548613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.551076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:18.553288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:18.555383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 110/218] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:18.561363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.572817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04381bba-fe4f-4ffe-82c1-6abce6eff3da admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.578127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.579535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.579824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.580096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.590451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:18.592834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:18.606465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 109/219] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:18.613821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.626684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4ace-e48f-4c04-8b36-a3393f449ccb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.632241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.633188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.633549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.633822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.635539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:18.639471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd527f-64fd-41c4-bdae-11661c38c9dc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:18.643156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 111/220] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:18.650133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:18.662545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf9d9d-77ca-4423-8229-0108fc793240 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:18.667934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:18.668673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:18.668956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:18.669233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:18.670210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] RBAC: Adding query filter params (role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=eb5e99f6cf364aaba3294c1205dca73a) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:18.670545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:18.674063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712f8f9-544e-4fe1-84e6-6ab727245490 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:18.682177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 110/221] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:18 2021] GET /identity/v3/role_assignments?user.id=eb5e99f6cf364aaba3294c1205dca73a&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=4dd88532ef744ea69be69bfd9975560b => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.024887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa9a-465d-4870-a139-617363866bc1 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.025284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa9a-465d-4870-a139-617363866bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.025760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7fa9a-465d-4870-a139-617363866bc1 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.029258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 112/222] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:19.055344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.055824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.056307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.095445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:19.097433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:19.115803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 111/223] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:19.161493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7fa9a-465d-4870-a139-617363866bc1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.184476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7fa9a-465d-4870-a139-617363866bc1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.193980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.195479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.195996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.196491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.219220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:19.233500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:19.236974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 113/224] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:19.248353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.267088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e220-48c5-468c-81ae-6d945c99b58e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.275004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.276138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.276633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.277094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.278578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:19.279124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.282483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.301906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 112/225] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.313020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.333416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057ab8-f27d-4c7b-9171-4d94c72ca532 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.341395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.343355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.343882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.344390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.347026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.350603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c1952-9cad-43b2-8723-9d1a89911929 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.354190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 114/226] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:19.366012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.386654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb941-f8b4-4ee0-a543-c5d3f486c8fc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.395589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.396745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.397305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.397854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.414247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.417876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.426862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7e49-d32f-48cf-b548-f5d5f03b394d None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.426862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7e49-d32f-48cf-b548-f5d5f03b394d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.426862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7e49-d32f-48cf-b548-f5d5f03b394d None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.430114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 115/227] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:19.439092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.439519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.439980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.445252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 113/228] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:19.480465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:19.482620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:19.499172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 116/229] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:19.504863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.521913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57861394-f090-41d8-ad99-5461b5f4fe7f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.529940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.532366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.532853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.533335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.535909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.540100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.544311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 114/230] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.556282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.572876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.577251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bd406-7e42-4a4f-936b-79cc1266445b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.587825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc58402-8dff-4147-9687-3576a1395149 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.591314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.592473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.592960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.593992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.606400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.607824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.611896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.612697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.617036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=caea61e355e24e9880292252c98a910d) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:19.619535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.625310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.644475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:19.656719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 115/231] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/role_assignments?user.id=caea61e355e24e9880292252c98a910d&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.669209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:19.672195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 117/232] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:19.679848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.700776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85776-ccda-42d2-bbca-2a674dd43e37 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.711494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.712758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.713271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.713773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.715362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:19.715887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.719423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.741145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 116/233] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:19.748168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.765679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde1ea-d9bc-421a-b790-e68cc2a08faa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.774138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.775226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.775655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.776133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.794894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.798687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.820632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 118/234] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:19.829402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.849005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733e09-47b7-4ecf-b1d4-06702e4f9e88 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.858035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.859816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.860362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.860827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.868164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.872213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.875787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 117/235] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.882966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.899798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40261dd5-cc38-410b-bc0c-3ce8bda9af3c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.908703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.910345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.910902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.911344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.924090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.925761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:19.925761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:19.925761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:19.928083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db166ac5-0e54-4650-a3ef-a7b372e73fd2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.931577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 119/236] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:19.938969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:19.960423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416491-3c9d-49ce-a44b-0f887289491b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:19.971585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:19.972801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:19.973246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:19.973707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:19.975313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:19.975858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:19.979555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8b06-1bf1-40f5-b560-6e768e7354ea admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:19.993929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 118/237] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:19 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=4dd88532ef744ea69be69bfd9975560b => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:20.851782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21175f3-4261-4508-b88a-5c6f14eff6b2 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:20.852439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21175f3-4261-4508-b88a-5c6f14eff6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:20.852810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21175f3-4261-4508-b88a-5c6f14eff6b2 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:20.856642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 120/238] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:20.873197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:20.873834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:20.874197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.111052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:21.114963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:21.135907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 119/239] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:21.231388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21175f3-4261-4508-b88a-5c6f14eff6b2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.263644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21175f3-4261-4508-b88a-5c6f14eff6b2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.272124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.273609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.274180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.274713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.300508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:21.321255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:21.323580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 121/240] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:21.335203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.352945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f039fad-70f5-415b-9f46-b90fc454c096 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.366342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.367530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.368046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.368611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.370098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:21.370745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:21.373866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:21.394397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 120/241] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:21.404823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.429625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788eac04-3ae0-4ebd-bb95-749dee876428 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.437883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.439584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.440124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.440600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.448175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:21.453313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:21.456669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 122/242] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:21.466946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.484060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96def1a-ee60-4d8f-8a01-87f995de8280 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.493743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.494807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.495313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.495784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.505464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:21.507836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:21.522213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 121/243] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:21.533205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.558632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142b48-f714-4660-9031-9c9ea68c3c03 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.571882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.573343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.573826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.574362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.578658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:21.582668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba20ef1-6975-407e-835b-bb46a87a8c3b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:21.586162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 123/244] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:21.598647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:21.611868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66387aa1-ff89-4f5b-9137-7c60f5c48622 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:21.621330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:21.622325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:21.622825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:21.623294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:21.624406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9, user.id=eb5e99f6cf364aaba3294c1205dca73a) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:21.624938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:21.627234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76d313-5edc-46a1-bfe2-b932325b8d17 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:21.634162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 122/245] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:21 2021] GET /identity/v3/role_assignments?user.id=eb5e99f6cf364aaba3294c1205dca73a&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.204872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc6f50-f918-457e-ba13-6e5ebdd86bf9 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.205435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc6f50-f918-457e-ba13-6e5ebdd86bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.205435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc6f50-f918-457e-ba13-6e5ebdd86bf9 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.207511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 124/246] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:22.214376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711b4-2395-4c75-96e0-15a126bc8076 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.215356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711b4-2395-4c75-96e0-15a126bc8076 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.215863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7711b4-2395-4c75-96e0-15a126bc8076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.247745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-9a7711b4-2395-4c75-96e0-15a126bc8076 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:22.249403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9a7711b4-2395-4c75-96e0-15a126bc8076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:22.257844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 123/247] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:22.277316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3ec5-98b9-432a-961b-18b37d8a53d3 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.277642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3ec5-98b9-432a-961b-18b37d8a53d3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.277879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3ec5-98b9-432a-961b-18b37d8a53d3 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.279783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 125/248] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:22.287243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.287868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.288441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.301003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3ec5-98b9-432a-961b-18b37d8a53d3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.313634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:22.315348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:22.324988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3ec5-98b9-432a-961b-18b37d8a53d3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.325980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 124/249] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:22.339445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.340405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.340694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.340971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.357249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:22.365071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:22.368685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 126/250] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:22.375354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.386474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848f86-d5d7-4b35-b53f-4b5d80a1f12b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.388188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.399094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb8bb7-3630-48c6-a55b-5b33c10b1d76 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.399630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.400586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.401084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.401559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.402592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:22.403251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.405820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.411309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.412163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.412455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.412736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.417441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 125/251] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:22.433432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:22.441717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:22.444947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.448002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 127/252] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:22.454892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.459816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca947e4-044b-42e4-a639-885861a59617 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.465623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c045-9364-4023-b915-7bc69d9cb3ce admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.471360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.472430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.472922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.473394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.477202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.477892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.478178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.478453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.479841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:22.479841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.481213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.486421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.488875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.495590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 128/253] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:22.499977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 126/254] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:22.510660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.517611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.525154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c3c9d-cb1f-48aa-ac26-bae1450dbcb3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.528479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8330a2-cb70-4e81-91c6-5d7db4375c45 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.540316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.541015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.541303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.541772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.543594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.544509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.544791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.545068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.551591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.553793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.558934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 129/255] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.559782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.561645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.563533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.580901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86af0c-9297-4b04-b583-1d05c0cf8711 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.583419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 127/256] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:22.590986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.599622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.600508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.600796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.601076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.603625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.605588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.612797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196988f2-98de-49e3-a4a1-57b820400b80 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.613408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 130/257] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.620012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.629982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.630965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.631256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.631536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.633843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.636447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.639099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 128/258] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.644733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7f257-de22-4a2a-973d-684703f8b12f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.650544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.654864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.656110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.656533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.656962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.657843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:22.658164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.660198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.675909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18613-3002-44a2-a1c6-8edb0d605a15 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.679071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 131/259] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 260 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.686587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.689147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.689552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.689961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.692260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.696050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:22.696050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:22.696050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:22.697561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ca7ac-0472-4004-978a-92795ed79b77 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.700683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 129/260] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:22.707948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:22.729243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66c894-33fc-4f9c-9ac8-47eab5749baa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:22.745525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:22.746677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:22.747122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:22.747530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:22.748902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:22.750083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:22.753284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066a98e-98b3-41d2-8904-844d30559c98 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:22.769779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 132/261] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:22 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 260 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:23.219631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b24f-11c7-4c50-82cb-f3b5080d9c6b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.220140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b24f-11c7-4c50-82cb-f3b5080d9c6b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.220613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b24f-11c7-4c50-82cb-f3b5080d9c6b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.224012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 130/262] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:23 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:23.230880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.231802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.232280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.379261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:23.380909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:23.398638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 133/263] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:23.426585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b24f-11c7-4c50-82cb-f3b5080d9c6b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.450642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b24f-11c7-4c50-82cb-f3b5080d9c6b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.458766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.459632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.459918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.460191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.478253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:23.494067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:23.495681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 131/264] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:23.502277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.515849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f096-85bc-43a1-8abb-7726cb8b9684 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.527252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.527946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.528224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.528495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.529274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:23.529576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:23.531835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:23.549484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 134/265] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:23.556161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.566930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1eb85-0852-4b9e-b7d8-628227a29a82 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.579908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.581407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.581696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.581972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.595085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:23.596977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:23.614280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 132/266] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:23.620893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.636622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9ef9-4d98-4802-9f17-fa51b272df15 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.651770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.652655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.652937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.653209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.654439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:23.658004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:23.660037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 135/267] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:23.666451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.676725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe575e42-4a77-4a62-aecb-ef7444c661cc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.686958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.688487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.688771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.689044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.690330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:23.692442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3c4c2-e808-427e-9c86-213ffb744be0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:23.694223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 133/268] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:23.702264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:23.714224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975adbf-374a-4e23-bc59-83e7a464cb10 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:23.724017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:23.724689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:23.724967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:23.725242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:23.726101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:23.726407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:23.728299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a1c13-23af-41a5-9f25-e569bddfd22d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:23.739400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 136/269] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:23 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=4dd88532ef744ea69be69bfd9975560b => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.016656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45456-e467-4941-a264-0a49d3e0fe5b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.017009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45456-e467-4941-a264-0a49d3e0fe5b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.017182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45456-e467-4941-a264-0a49d3e0fe5b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.019335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 134/270] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:24.027858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.028158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.028404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.051954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:24.053221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:24.064251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 137/271] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:24.099914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a45456-e467-4941-a264-0a49d3e0fe5b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.125037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a45456-e467-4941-a264-0a49d3e0fe5b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.129994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.130996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.131294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.131573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.148590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:24.156000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:24.157400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 135/272] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:24.163982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.173484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b297557-ddf2-404d-8a9e-dd776d4c4a39 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.180691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.181378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.181663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.181937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.182754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:24.183063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.184692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.198220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 138/273] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.205259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.217683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a689-195a-4dc1-9041-77c96f381345 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.224083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.225557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.226055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.226598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.228777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.232654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.236307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 136/274] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.247370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.261777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f944-8d1b-4b32-8abb-1596012ab9fb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.267588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.268549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.268883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.269271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.270570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.272984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bea634-d1e2-466c-bd87-6b356a3404cd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.275102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 139/275] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.282249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.299094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0949ec-87b4-4370-965b-07b5bd86e7e2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.306683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bc33-5c3a-4957-b1a9-b0cc4b5aa7e2 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.307546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bc33-5c3a-4957-b1a9-b0cc4b5aa7e2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.308365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9bc33-5c3a-4957-b1a9-b0cc4b5aa7e2 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.308551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.309315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.309603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.309890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/groups/d5673203f43842aa84e93574ddabe5cd/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.312551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da7e807d8e4ae2b696b96a98712ae1, group_id=d5673203f43842aa84e93574ddabe5cd, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.314222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 140/276] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:24 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:24.320161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.327991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.328921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.329451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.355050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 137/277] 10.222.0.76 () {58 vars in 1463 bytes} [Thu Oct 28 08:27:24 2021] PUT /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/groups/d5673203f43842aa84e93574ddabe5cd/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:27:24.370707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:24.372341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:24.446457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 141/278] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:24.475714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.488206 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5495e-6497-4108-b52a-1985b1e7f5de admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.496551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.497743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.498257 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.498831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.516476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:24.524209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:24.525752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 138/279] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:24.533064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.543241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56440-79ec-4418-bd38-503b94fdae7f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.552282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.552996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.553276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.553536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.554355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:24.554674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.556354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.577416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 142/280] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.584979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.602540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc729da5-cb1f-44ee-82ac-476d5ec5d04b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.611551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.612782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.613299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.613797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.628020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.630228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.645705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 139/281] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:24.652591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.673258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3479105-af09-4e0c-bcc2-078ef267f931 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.678040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.679181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.679455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.679738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.681026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] RBAC: Authorizing `identity:get_project(project_id=ff2c85101aec4012bf80ddd35cbbddef)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.687970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.690323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 143/282] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.696759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.706428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d8a30-2ba0-4e62-8174-5d3f55ff1d0f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.718657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.720007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.720493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.720968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] PATH_INFO: `/v3/groups/1ed75d575c4848dbb84e48e617dc70eb` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.731492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] RBAC: Authorizing `identity:get_group(group_id=1ed75d575c4848dbb84e48e617dc70eb)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.734387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665370e-769c-44e3-9707-60a910adaea4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.736784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 140/283] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/groups/1ed75d575c4848dbb84e48e617dc70eb => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:24.744293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:24.760826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89560-0f45-4d24-82c7-fe4c0e57bd4d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:24.765595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:24.766363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:24.766695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:24.766985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:24.767844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] RBAC: Adding query filter params (group.id=1ed75d575c4848dbb84e48e617dc70eb, role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=ff2c85101aec4012bf80ddd35cbbddef) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:24.768186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:24.770054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb3ecf-ab78-416c-b5e8-f0f687e408ef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:24.781717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 144/284] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:24 2021] GET /identity/v3/role_assignments?group.id=1ed75d575c4848dbb84e48e617dc70eb&scope.project.id=ff2c85101aec4012bf80ddd35cbbddef&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:25.971465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8957b-aa70-4c95-93b6-3b5a76d5f4ad None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:25.972006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8957b-aa70-4c95-93b6-3b5a76d5f4ad None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:25.972006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8957b-aa70-4c95-93b6-3b5a76d5f4ad None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:25.974064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 141/285] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:25.979903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:25.980374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:25.980674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.003602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:26.004880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:26.013073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 145/286] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:26.025693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c482-2dc8-4bce-8be9-3a9f62d14edc None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.025977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c482-2dc8-4bce-8be9-3a9f62d14edc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.026258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389c482-2dc8-4bce-8be9-3a9f62d14edc None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.028364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 142/287] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:26.039291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.049507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdfb71-19c9-4ba0-a0ec-f84cdd78ed2d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.049950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.050238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.050553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.054231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.055330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.055738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.056037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.068573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:26.076357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:26.079704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 146/288] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:26.081690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:26.083541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:26.086527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.098055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0757ba-f68f-4fb1-98fd-ee90788bcfa9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.102661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.103373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.103658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.104058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.105271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:26.105588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.107118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 143/289] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:26.107383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.117663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 147/290] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:26.123706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.134669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.135744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0dc81-fea9-4b54-84a3-aa294f9fc59e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.146267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2cbb6-bdab-437e-b488-69041fb6feee admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.150973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.152137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.152427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.152597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.152721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.153460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.153740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.154013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.159250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.161235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.163198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 144/291] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:26.165449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:26.177748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:26.179097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 148/292] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:26.181787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.186262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.208183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f36475-2d5b-4898-a9a9-899dd6a6324b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.209489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b024d-d67d-499d-84f1-d0abfa7ca763 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.219938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.220638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.220926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.221206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.222093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:26.222348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.224088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.226666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.227595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.227896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.228175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.229541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.231730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.233566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 145/293] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:26.246475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 149/294] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:26.249675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.255693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.267510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0de74-6aa2-42a3-94dd-cb0dde0b485d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.273246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a278b3-820a-4adf-bdaf-89f120e6f54e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.276857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.277738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.278023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.278303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/groups/d5673203f43842aa84e93574ddabe5cd/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.283494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0ee93171e4ccdb458be8889b4d5e9, group_id=d5673203f43842aa84e93574ddabe5cd, role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.286171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.289735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.290639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.290921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.291195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.292403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.294321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.297495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 150/295] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:26.304082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.318544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 146/296] 10.222.0.76 () {58 vars in 1463 bytes} [Thu Oct 28 08:27:26 2021] PUT /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/groups/d5673203f43842aa84e93574ddabe5cd/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:26.323089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071cd45-5c21-40e5-8762-1f1265558fa9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.401991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.402889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.403175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.403454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.406465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.408404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06463c3c-5466-49a4-a26b-9ff35d89855d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.410365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 151/297] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:26 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:26.417219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:26.431551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d253fd-1035-4af0-8a18-264da3055c98 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:26.440731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:26.441635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.441918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.442194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/groups/d5673203f43842aa84e93574ddabe5cd/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.444653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da7e807d8e4ae2b696b96a98712ae1, group_id=d5673203f43842aa84e93574ddabe5cd, role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:26.447363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f511b47-ec6e-4ba1-85c6-6d0a82c8eb37 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:26.469681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 147/298] 10.222.0.76 () {58 vars in 1463 bytes} [Thu Oct 28 08:27:26 2021] PUT /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1/groups/d5673203f43842aa84e93574ddabe5cd/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:26.929502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d81c-d66a-4d23-8d3a-fd8a08650c4c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.929769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d81c-d66a-4d23-8d3a-fd8a08650c4c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.930174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17d81c-d66a-4d23-8d3a-fd8a08650c4c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.931868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 152/299] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:26.940668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:26.941063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:26.941333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:26.965728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:26.966998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:27.038931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 148/300] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:27.074839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17d81c-d66a-4d23-8d3a-fd8a08650c4c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.089457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17d81c-d66a-4d23-8d3a-fd8a08650c4c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.096785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.097606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.097883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.098157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.111823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:27.119219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:27.120797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 153/301] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:27.127368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.136901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e46d3-4e9f-4708-855f-ff0fa0c5958c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.145779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.146456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.146777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.147059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.147839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:27.148148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.149789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.165645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.166090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 149/302] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:27.176291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9656407-542f-4f18-a52f-9d02ca18a2e5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.188397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.189212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.189496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.189772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.195340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.197395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.199357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 154/303] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:27.206011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.216649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace3495-5088-40a8-beb1-15fc7679f219 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.226677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.227561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.227852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.228126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.229855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.232212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259e5a9-c4c1-48cc-826f-d39d3afaa2a0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.234768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 150/304] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:27.241301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.258939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4309e-b0ed-42ea-b2c6-e5342a2aacd5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.266725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.267618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.267895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.268166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/groups/d5673203f43842aa84e93574ddabe5cd/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.275743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0ee93171e4ccdb458be8889b4d5e9, group_id=d5673203f43842aa84e93574ddabe5cd, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.278427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6400d5-d573-4e60-bcc7-6dbbd4f406be admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.297055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 155/305] 10.222.0.76 () {58 vars in 1463 bytes} [Thu Oct 28 08:27:27 2021] PUT /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9/groups/d5673203f43842aa84e93574ddabe5cd/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:27.658811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdfd3-a8d4-4864-acd5-c4c40c5fd80c None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.659534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdfd3-a8d4-4864-acd5-c4c40c5fd80c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.660045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cacdfd3-a8d4-4864-acd5-c4c40c5fd80c None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.662071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 151/306] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:27.668596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.668896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.669166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.691097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:27.692315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:27.757857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 156/307] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:27.783378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdfd3-a8d4-4864-acd5-c4c40c5fd80c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.797055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cacdfd3-a8d4-4864-acd5-c4c40c5fd80c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.803823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.804697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.804979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.805304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.818122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:27.825525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:27.827148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 152/308] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:27.833955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.844315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae791f0-295a-4c3f-b041-f91253f7a2b8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.849169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.849869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.850154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.850746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.851540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:27.851846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.853622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.864699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 157/309] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:27.870952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.881912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290f39-4a7f-461e-927f-d7530bf334b1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.886769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.887672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.888005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.888283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] PATH_INFO: `/v3/groups/1ed75d575c4848dbb84e48e617dc70eb` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.889565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] RBAC: Authorizing `identity:get_group(group_id=1ed75d575c4848dbb84e48e617dc70eb)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.891996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.894064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 153/310] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/groups/1ed75d575c4848dbb84e48e617dc70eb => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:27.900325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.913020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a42b2-446e-4147-8000-31b7aa07f74d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.919557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.920493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.920829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.921668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.923191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] RBAC: Authorizing `identity:get_project(project_id=ff2c85101aec4012bf80ddd35cbbddef)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.925170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262b405-1b78-4555-9322-5094a900b850 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.927085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 158/311] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:27 2021] GET /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:27.933936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:27.946131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d098c3-0fb0-43d4-99c0-719531e53d92 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:27.950975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:27.952287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:27.952577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:27.952861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef/groups/1ed75d575c4848dbb84e48e617dc70eb/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:27.955126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2c85101aec4012bf80ddd35cbbddef, group_id=1ed75d575c4848dbb84e48e617dc70eb, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:27.957932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7ed44-46ce-45bb-b11e-fbad6fb592c9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:27.975622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 154/312] 10.222.0.76 () {58 vars in 1463 bytes} [Thu Oct 28 08:27:27 2021] PUT /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef/groups/1ed75d575c4848dbb84e48e617dc70eb/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:28.001679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b846c-6a7f-4a6d-a188-eecc020a4a8a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.002002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b846c-6a7f-4a6d-a188-eecc020a4a8a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.002234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b846c-6a7f-4a6d-a188-eecc020a4a8a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.004237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 159/313] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:28.010821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.011115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.011382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.031638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:28.032911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:28.113275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 155/314] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:28.151030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b846c-6a7f-4a6d-a188-eecc020a4a8a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.166907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b846c-6a7f-4a6d-a188-eecc020a4a8a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.173909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.174803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.175140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.175419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.193839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:28.201237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:28.203879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 160/315] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:28.211957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.229369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8c573-d5d7-42a0-9f34-dacafbf1d93e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.237528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.238215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.238526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.238853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.239660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:28.240017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:28.241720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:28.255862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 156/316] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:28.262210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.275992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f7544-0ae4-44ea-a542-9b0516180d2c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.287057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.287737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.288022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.288298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.300208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:28.302015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:28.312350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 161/317] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:28.318233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.328630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd27b8-c5cc-43ee-affa-36a2e271c113 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.333780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.334718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.335002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.335328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.336580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:28.338787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:28.340868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 157/318] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:28.347559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.356757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc31d-6979-4fc7-86b1-652e583696db admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.361456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.362677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.362957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.363280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.364524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:28.366611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a01ac-653a-400f-b4f1-1622b4dbc043 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:28.368320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 162/319] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:28.375261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:28.385839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931ae4f-068f-4e7c-8700-91b97cc382f2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:28.391481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:28.392161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:28.392483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:28.392767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:28.393673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:28.393998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:28.396138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736fe01-89e3-4fec-ac38-f0216301abe5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:28.403255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 158/320] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:28 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=4dd88532ef744ea69be69bfd9975560b => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:29.403212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803871-a43a-4205-bb67-d94ae80892a0 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.403937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803871-a43a-4205-bb67-d94ae80892a0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.403937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01803871-a43a-4205-bb67-d94ae80892a0 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.406843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 163/321] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:29.414973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.415598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.415598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.439226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:29.440452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:29.449165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 159/322] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:29.475141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803871-a43a-4205-bb67-d94ae80892a0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.488982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01803871-a43a-4205-bb67-d94ae80892a0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.493449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.494257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.494564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.494835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.521881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:29.529332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-bb834e91-9253-4be3-b20d-ff1bfb8818cb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:29.531001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 164/323] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:29.537659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.547608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c0e35-86a0-466e-9753-29b8ac50ec72 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.552363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.553057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.553337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.553612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.554408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:29.554746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.556442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.564324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b2209-cd7b-4684-b914-aced2037c66f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.564634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b2209-cd7b-4684-b914-aced2037c66f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.564868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b2209-cd7b-4684-b914-aced2037c66f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.568506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 165/324] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:29.568936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 160/325] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:29.572639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.572921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.573199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.577390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.590061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51217a-0f54-4922-99bc-d1e9201d279e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.594888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:29.596333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:29.600124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.600859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.601273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.601556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.604749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 166/326] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:29.611276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.613310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.623378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 161/327] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:29.630279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.638947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.643274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf1fb7-48ab-44ce-8eef-ae9acfe8b769 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.654352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.655111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77732d1-72b4-470f-80eb-ef324c0a1b55 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.655225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.655579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.656617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.657947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.660398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.662128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 167/328] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:29.663331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.664160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.664442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.664718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.669377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.681804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:29.684132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b224d6-f435-4582-8159-d4347167cd89 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.691431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:29.693355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 162/329] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:29.696134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.697176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.697633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.699120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.699696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.703204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.705564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.707980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 168/330] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:29.711735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e67e-4c9d-43ba-92ce-e08864e39076 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.715921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.719213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.719892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.720178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.720457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.721244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:29.721555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.723511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.728707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224a0c6-3b2b-4fd3-93f7-ddebdd42cb2c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.734313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 163/331] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:29.735934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.739453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.740304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.740889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.741419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.742388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:29.742987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.745200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.753871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad36cda-4d1b-49d9-b1a2-36d81786ca40 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.754174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 169/332] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:29.766897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.767819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.768202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.768583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.778875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.781085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.792188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 164/333] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:29.798678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.814011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff36fa-5bf3-44ca-820c-a60568ba72ad admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.819473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.820680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.821235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.821722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.823393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.825811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.828699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 170/334] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:29.835316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.846046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb4341-c3c3-4289-9d54-da3584a51624 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.853656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.854977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.855439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.855925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.857526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.860643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38da1f-8ac1-4086-93fa-2ff589cbb801 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.863493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 165/335] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:29.870401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:29.882732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb512-82f8-4bb0-b956-cd68e788ea5c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:29.888152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:29.889209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:29.889775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:29.890276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:29.891430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=32da7e807d8e4ae2b696b96a98712ae1) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:29.891977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:29.894236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acfa1c-2a74-4a89-8d75-db440c90b333 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:29.901877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 171/336] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:29 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=32da7e807d8e4ae2b696b96a98712ae1&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.278669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ed43-3ebc-44ef-8bbd-7ffb1a24cdf9 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.278991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ed43-3ebc-44ef-8bbd-7ffb1a24cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.279227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21ed43-3ebc-44ef-8bbd-7ffb1a24cdf9 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.281183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 166/337] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:30.287584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.288006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.288391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.309650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:30.310950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:30.319354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 172/338] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:30.344444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21ed43-3ebc-44ef-8bbd-7ffb1a24cdf9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.357316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21ed43-3ebc-44ef-8bbd-7ffb1a24cdf9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.363029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.363826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.364104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.364492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.376245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:30.383275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 08:27:30.384490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 167/339] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:30.391539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.400637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17effc-d19c-4668-8817-21c6c24af99e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.405112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.406439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.406752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.407024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.407796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:30.408097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.409691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.418468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 173/340] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.425325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.435641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe96c-5fa1-4947-9b7f-4f0cf3b464c4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.441316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.441952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.442238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.442525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.450946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.453359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.462569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 168/341] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:30.468907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.478864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c109b-2ba6-46fd-ba51-ec0b41e92a02 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.483150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.484520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.484788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.485056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.486250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.488577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.490245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 174/342] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.496317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.506221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b060-dcce-4b06-ae9c-e89681e91e75 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.510540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.511372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.511651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.511921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] PATH_INFO: `/v3/groups/d5673203f43842aa84e93574ddabe5cd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.513085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] RBAC: Authorizing `identity:get_group(group_id=d5673203f43842aa84e93574ddabe5cd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.515651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127109-ed8e-4fb8-81da-e0b408a23e0c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.517236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 169/343] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/groups/d5673203f43842aa84e93574ddabe5cd => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.523853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.533641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a19e7-a676-4541-90bb-d2aa801ccca5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.538151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.538840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.539130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.539401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.540248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] RBAC: Adding query filter params (group.id=d5673203f43842aa84e93574ddabe5cd, role.id=4dd88532ef744ea69be69bfd9975560b, scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:30.540560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.542419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7a455-00b1-4c7e-bdf6-94e208a4fcde admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.549506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 175/344] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/role_assignments?group.id=d5673203f43842aa84e93574ddabe5cd&scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9&role.id=4dd88532ef744ea69be69bfd9975560b => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.823090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca1a8-2fe6-46bd-b7f8-a0170d7244b6 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.823375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca1a8-2fe6-46bd-b7f8-a0170d7244b6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.823683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca1a8-2fe6-46bd-b7f8-a0170d7244b6 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.825647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 170/345] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:30.831859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.832150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.832431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.851015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:30.852209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:30.860412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 176/346] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:30.885143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca1a8-2fe6-46bd-b7f8-a0170d7244b6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.900867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca1a8-2fe6-46bd-b7f8-a0170d7244b6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.906378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.907244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.907526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.907803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.919073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:30.926703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:30.927926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 171/347] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:30.934452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.943777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87f629-c18d-4fc5-8755-9c393ce44619 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.948301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.948966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.949247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.949520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.950287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:30.950610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.952539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:30.962343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 177/348] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:30.969029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:30.978807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a603e0-a266-42dc-86dc-d48389b0332f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:30.983294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:30.984504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:30.984975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:30.985196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:30.994821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:30.996591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:31.006238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 172/349] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:31.012656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:31.022475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6cab-ec3a-42c5-8dd0-43a5a7fbf36c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:31.026963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:31.027814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:31.028096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:31.028370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:31.029573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] RBAC: Authorizing `identity:get_project(project_id=ff2c85101aec4012bf80ddd35cbbddef)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:31.031924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:31.033594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 178/350] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:27:31 2021] GET /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:31.039720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:31.050303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c316bba-1d15-4a19-85d4-43164c0bfc73 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:31.054943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:31.055789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:31.056068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:31.056340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] PATH_INFO: `/v3/groups/1ed75d575c4848dbb84e48e617dc70eb` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:31.057561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] RBAC: Authorizing `identity:get_group(group_id=1ed75d575c4848dbb84e48e617dc70eb)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:31.059500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0fec4-74be-47b8-8a24-cff58dd9cadf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:31.061077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 173/351] 10.222.0.76 () {56 vars in 1201 bytes} [Thu Oct 28 08:27:31 2021] GET /identity/v3/groups/1ed75d575c4848dbb84e48e617dc70eb => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:31.068995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:31.079813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69352c7-7ec2-44d8-b6c4-30db8508e6fe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:31.084370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:31.085049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:31.085323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:31.085598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:31.086448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] RBAC: Adding query filter params (group.id=1ed75d575c4848dbb84e48e617dc70eb, role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=ff2c85101aec4012bf80ddd35cbbddef) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:31.086788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:31.088638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467df040-0a6e-4f5c-8ad0-8e28cc68c899 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:31.095841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 179/352] 10.222.0.76 () {56 vars in 1397 bytes} [Thu Oct 28 08:27:31 2021] GET /identity/v3/role_assignments?group.id=1ed75d575c4848dbb84e48e617dc70eb&scope.project.id=ff2c85101aec4012bf80ddd35cbbddef&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:34.012577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519843f2-cc89-4a1a-9049-cec672861884 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.013335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519843f2-cc89-4a1a-9049-cec672861884 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.013335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519843f2-cc89-4a1a-9049-cec672861884 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.015235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 174/353] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:34.022268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.022968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.022968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.041583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:34.047691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:34.061196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 180/354] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:34.098728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519843f2-cc89-4a1a-9049-cec672861884 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.119244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519843f2-cc89-4a1a-9049-cec672861884 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.123977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.124779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.125098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.125473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.141967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.143863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.174380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:34.180977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 175/355] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:34.182357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.192570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4acf3-cfda-48c5-bae4-bc90142b51c3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.203817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.204493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.204774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.205047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.205820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:34.206129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.207863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80596c41-3216-4a0e-87e4-e55549561a2b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.222470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 181/356] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:34.228498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.243829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fab13-b171-41bc-befd-6a083c6f46fd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.252640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.253315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.253597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.253873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.254647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.256645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f637c-5400-45b5-ad5f-a534f2761af3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.284165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 176/357] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/users => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:34.310763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a139-c15d-4aa9-bfa1-e3d5b66879d0 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.311088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a139-c15d-4aa9-bfa1-e3d5b66879d0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.311323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a139-c15d-4aa9-bfa1-e3d5b66879d0 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.313881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 182/358] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:34.323002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5854e-9966-4e8c-967d-314ca587c405 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.323351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5854e-9966-4e8c-967d-314ca587c405 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.323557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5854e-9966-4e8c-967d-314ca587c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.355884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-77d5854e-9966-4e8c-967d-314ca587c405 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:34.357272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-77d5854e-9966-4e8c-967d-314ca587c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:34.367998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 177/359] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:34.409381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118a139-c15d-4aa9-bfa1-e3d5b66879d0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.426673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118a139-c15d-4aa9-bfa1-e3d5b66879d0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.434931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.435750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.436034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.436310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.455272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.457166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb827e-1218-4b3d-9d0b-a5cc1b4c115b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.457377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.457534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb827e-1218-4b3d-9d0b-a5cc1b4c115b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.457833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb827e-1218-4b3d-9d0b-a5cc1b4c115b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.459990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 178/360] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:34.465900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371492b-9064-4994-8392-4cc958e7899c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.466201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371492b-9064-4994-8392-4cc958e7899c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.466436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371492b-9064-4994-8392-4cc958e7899c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.476292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:34.483022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 183/361] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:34.485496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.506565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8b41-d4c6-4bd9-84d9-d2a7208c6c6c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.517456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4371492b-9064-4994-8392-4cc958e7899c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:34.518736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4371492b-9064-4994-8392-4cc958e7899c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:34.519183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.520359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.521002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.521506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.522880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:34.523431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.526678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.541205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 179/362] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:34.558729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 184/363] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:34.564729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371492b-9064-4994-8392-4cc958e7899c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.581845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.585260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371492b-9064-4994-8392-4cc958e7899c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.597849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01711f9a-9dbe-440b-9768-38f3e21673e2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.602168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.602891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.603169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.603473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.603755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.604230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.604727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.605114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.605476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.606273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.619335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.622207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.635560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 180/364] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/users => generated 248 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:34.648209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:34.649611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 185/365] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:34.657145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.675165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947381f1-174a-464a-9207-aa88ca34e1b4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.682745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.683443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.683725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.683999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.684835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:34.685141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.686193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:34.686193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:34.686193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:34.687647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8932502-f991-408a-a3b8-66b17bdfe117 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.714681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 181/366] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:34.717578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:34.731224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38644d14-5412-4c09-8ae4-53589bb68bef admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:34.743392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:34.744101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:34.744397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:34.744671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:34.745417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:34.747529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76003587-932f-4316-aae9-b51b6246c89f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:34.772747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 186/367] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:34 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:27:35.422642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdde3e-5900-4db4-b504-0f0b5bda7aad None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:35.422642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdde3e-5900-4db4-b504-0f0b5bda7aad None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:35.422642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdde3e-5900-4db4-b504-0f0b5bda7aad None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:35.425266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 182/368] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:35.446488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:35.446488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:35.446488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:35.475598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:35.477193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:35.492873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 187/369] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:35.544228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdde3e-5900-4db4-b504-0f0b5bda7aad None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:35.577751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdde3e-5900-4db4-b504-0f0b5bda7aad None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:35.592764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:35.594810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:35.595645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:35.596456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:35.626667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:35.629512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:35.670613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:35.673457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 183/370] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:35.679839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:35.697337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f6404-c1dd-4add-a031-00f884d97bb7 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:35.711474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:35.712539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:35.713033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:35.713592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:35.714572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:35.715375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:35.718440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110a1f7-11ea-4983-89eb-8b4a9512b130 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:35.744533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 188/371] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:35.751316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:35.770226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aff10-10db-4518-beea-7abb845b980b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:35.782070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:35.787587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:35.788119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:35.788616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:35.789565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:35.794869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac97771-65f5-4a38-815d-3d1326e4f5ac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:35.833094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 184/372] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:35 2021] POST /identity/v3/users => generated 249 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:36.183180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839afe7-2209-4c98-9ca5-5cb6a700de00 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:36.184053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839afe7-2209-4c98-9ca5-5cb6a700de00 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:36.184802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839afe7-2209-4c98-9ca5-5cb6a700de00 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:36.187902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 189/373] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:36.195898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:36.196831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:36.197488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:36.224696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:36.226338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:36.239862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 185/374] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:36.268112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839afe7-2209-4c98-9ca5-5cb6a700de00 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:36.283703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839afe7-2209-4c98-9ca5-5cb6a700de00 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:36.288889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:36.289875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:36.290397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:36.291034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:36.292016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:36.293312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:36.293312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:36.293312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:36.294618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:36.304748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.sql.core [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 08:27:36.304748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 08:27:36.304748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [parameters: {'id': 'f449568e504b4dc2a698b9735de32b8c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 08:27:36.304748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 08:27:36.320491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 08:27:36.322668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 190/375] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:27:36 2021] POST /identity/v3/roles => generated 144 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:36.331027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:36.341621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bb83-39c9-4d00-a3d3-f1542f2648c2 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:36.347275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:36.348499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:36.349020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:36.349513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:36.362696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:36.370636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-700d8c17-e0f4-4300-bd66-ae15daad55ae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 08:27:36.372511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 186/376] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:27:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:36.380311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:36.393961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a2cc1-9ed2-4d7c-954c-2ee2f8c14af1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:36.402011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:36.403166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:36.403693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:36.404179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:36.405447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:36.406344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:36.409072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f48f38-0700-4701-940a-91060fabde7c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:36.421798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 191/377] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:37.387033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506907-4584-4795-8029-a134c1b83224 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.388140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506907-4584-4795-8029-a134c1b83224 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.388633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506907-4584-4795-8029-a134c1b83224 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.391647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 187/378] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:37.398005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.398980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.399507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.424750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:37.426313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:37.441089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 192/379] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:37.484769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506907-4584-4795-8029-a134c1b83224 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.500180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506907-4584-4795-8029-a134c1b83224 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.505290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.506400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.506932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.507429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.519755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:37.527417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:37.529290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 188/380] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:37.536162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.546740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad90b1-546e-48db-b96e-1e2d7d58b827 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.554845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.555881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.556357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.556822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.557844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:37.558351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.560199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.570110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 193/381] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:37.576486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.591818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b616e146-d4e2-4765-915b-af7aadc45f9e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.600143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.601348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.601836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.602338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.619147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.621340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.643248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:37.645192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 189/382] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:37.651278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.662319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048fe37-8bdd-4aca-aa43-59e1525c0525 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.670835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.672191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.672677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.673155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.674179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:37.674698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.676540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.693602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 194/383] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:37.700087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.715883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741762-41fe-4ee2-b151-069fc7ffdd22 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.721209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.722402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.722917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.723379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.737449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.740036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.761868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-93cacedd-ffcb-43b5-a5b0-75d476d3a074 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:37.763891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 190/384] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:37.771095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.789143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232f808-97c1-4c35-a223-c33ff0ba854f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.799003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.799721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.800009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.800296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.801218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:37.801533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.802623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:37.802623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:37.802623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:37.803824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.907272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4587-7ced-4657-91c8-0668381289a0 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.907886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4587-7ced-4657-91c8-0668381289a0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.908355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4587-7ced-4657-91c8-0668381289a0 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.910758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 191/385] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:37.914616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 195/386] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:37.917922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc533-20fa-4cab-8286-5fd923a68aa5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.918104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.918804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc533-20fa-4cab-8286-5fd923a68aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.919300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc533-20fa-4cab-8286-5fd923a68aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.941975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d328d70-1465-407e-aed0-adde2cc17659 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:37.949006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:37.949743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.950023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.950302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.959777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:37.960314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-702bc533-20fa-4cab-8286-5fd923a68aa5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:37.961597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:37.961713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-702bc533-20fa-4cab-8286-5fd923a68aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:37.971137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 192/387] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:37.972603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a1ac-2558-4fe2-b6a5-325673577a17 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.972835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 196/388] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:37.973135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a1ac-2558-4fe2-b6a5-325673577a17 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.973417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a1ac-2558-4fe2-b6a5-325673577a17 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:37.975195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 193/389] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:37.979774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:37.985436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:37.985825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:37.986100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.001151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaafd02-edea-418b-91e6-1e15b460bfc0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.007517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.009123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.009916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.010727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.012479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:38.013767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:38.023184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 194/390] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:38.024039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.027347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.029881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.035156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13824271-f3e5-4b8f-95d0-d2c2a0aff968 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.040587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.041455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.041748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.042539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.052570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:38.054378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 197/391] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.056347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:38.065019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:38.065933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.066801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 195/392] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.071633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.079891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ba2a7-952d-4965-9e9d-53958c6ea911 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.086055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.087942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.088236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.088515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.089620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.089940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.093572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.099135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdb860-4464-4d55-afc1-4435c1489671 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.104304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.105482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.105980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.106441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.109020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 198/393] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.110305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.121597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:38.123619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b768911d-094e-47c3-b5f6-9a6057ae8175 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.129385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.130095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.130397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.130746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.131451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:38.131622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.131889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.133339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 196/394] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.133708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.140432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.143713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 199/395] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.144486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.156198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e3999-a761-4a71-9514-69b1569aeaec admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.161374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.161521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007768e-5e32-4d3d-923e-93a92d0592ba admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.162672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.163163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.163606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.167473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.168925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.169315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.169602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.170536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.171571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.174124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.174710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.177245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.185144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 200/396] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.186125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.196517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:38.198672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 197/397] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.199277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664c6d-2081-4ebe-8f44-d3a428c23613 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.204246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.205379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.206348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.206744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.207162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.221644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.223724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.225577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a5e6-ff14-4ca7-826c-f7980e135330 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.233713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.235620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.236396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.237335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.243921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:38.245511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 201/398] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.251114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.255635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.257550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.271500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83bd3d-f8f6-4f56-9175-dc041bcbb576 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.276728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:38.277528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.278120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 198/399] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:38.284088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.285943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.286451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.287102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.288364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.288967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.289137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d2ca-521c-4d12-bc83-f13546e67295 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.290544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:38.290544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:38.290544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:38.292940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.293918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.294611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.294891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.295163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.296118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.296605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.298254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.310957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 199/400] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.316536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.323013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b295e-5de2-456f-ae39-5547b2cbdbc6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.329222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.329868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.330140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.330408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.331214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.331512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.333213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.335659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 202/401] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.337654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.346836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 200/402] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.347753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.357812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6842f-0c17-4637-9902-c7c016261d11 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.363598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1548f-613f-40e8-8ad4-f3dfd8e213eb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.367740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.368629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.369273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.369630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.369903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.370791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.371113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.371702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.372611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.373005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.374404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.381091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 201/403] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.381321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.392340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6523b9-f669-4d92-a3da-038d72b10a4c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.397518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.398340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.398708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.399004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.408184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.410189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.411026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.421484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.427994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 08:27:38.429263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 202/404] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.435779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.452811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d9176-5ca3-4d89-a617-c92961b998fb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.458331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 08:27:38.461279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 203/405] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/users/glance => generated 84 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.473439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.479450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.480148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.480428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.480876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.481681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.481987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.484312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:38.484312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:38.484312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:38.485028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.489248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d69976-e74a-4bb9-9dcd-9c6f8f5c53c6 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.506210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.509861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.510482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.511042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.513220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.515032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.521130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.559387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 204/406] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:38.572899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.585788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 203/407] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:38.589136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093abcc-84dd-4e4f-a41c-a5880382b00d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.592412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.603529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.605322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.605856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.606757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.614096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafea3d3-53a0-4150-9444-b30937030d91 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.620962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.622184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.622739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.623279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.623478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.625507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.635285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.637653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.645846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 205/408] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:38.650642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 204/409] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:38.658163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.660478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.672567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a2cb-b870-4667-b5e8-e2a81ef73485 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.678536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.679366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.679691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.679961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.684878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419112-6ac6-4657-94d0-ee477d040f5e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.692791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.694734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.708876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.709700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.709986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.710267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.718809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:38.720623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 205/410] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:38.731014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.738913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.740816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.746422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24277b5-f54b-48df-861a-66019f9d229c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.751860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.752562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.752844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.753115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.753857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.754156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.755816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.770115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 206/411] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:38.776143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.779571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:38.782043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 206/412] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.794536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.802376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e91912-2cef-4f54-8301-efe529ebe864 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.812256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b3fe-0590-4fa2-b74f-f5901c7354fc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.815609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.816456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.816766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.817103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.825558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.826249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.826545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.828188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.831511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.832800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.835644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.855190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.860820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.875900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 207/413] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:38.887561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.890820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:38.892309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 207/414] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:38.898260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.909055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c3650-06b5-4f1c-8103-8614d9e97d5d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.910058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cdaa2-7832-43a8-a032-230af00bbfd7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.917047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.917856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.918141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.918424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.919749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.920628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.921656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.922080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.923193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.923443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.924525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:38.924525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:38.924525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:38.925984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.939776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:38.941805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:38.948064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 208/415] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:38.959818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:38.984004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011c210-6498-421a-8735-d4ace6c145b9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:38.985802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:38.987546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 208/416] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:38.995933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:38.996666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:38.997007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:38.997311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:38.998244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=97167b82c21643c08543bf5d6323c599) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:38.998602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.000968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.007214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.017114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba87df0-aea0-485c-964c-43aeda203e36 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.026800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 209/417] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/role_assignments?user.id=97167b82c21643c08543bf5d6323c599&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.029324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.030561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.031510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.031878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.032710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.033043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.035164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b58586-db61-4c29-8a24-fcf475966c30 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.049075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 209/418] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:39.056413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.068147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cacbb-a23c-43da-8c78-479741e22e9a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.086653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.087376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.087679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.087956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.088888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=64c05096a69740909d10c748be820840) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.089195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.097233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dac1bf-26ae-45d9-b6bd-21a57e4ddc5d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.111829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 210/419] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/role_assignments?user.id=64c05096a69740909d10c748be820840&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.132326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd062b-f27f-423e-9a33-c35893cb3c01 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.132614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd062b-f27f-423e-9a33-c35893cb3c01 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.132916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd062b-f27f-423e-9a33-c35893cb3c01 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.134837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 210/420] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:39.148205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.148496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.148775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.175946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:39.177422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:39.190287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 211/421] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:39.229952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd062b-f27f-423e-9a33-c35893cb3c01 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.250812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd062b-f27f-423e-9a33-c35893cb3c01 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.257674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.258550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.258838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.259156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.275476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:39.286737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:39.288122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 211/422] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:39.294708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.307978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983f4b1-a6da-4bc5-93a7-fb1959f06c5b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.313132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.314130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.314638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.315060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.316009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.316464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.318273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.329654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 212/423] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.338537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.353547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a621c-f0b0-4fd6-82eb-d87ab62e7c48 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.363784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.364604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.364885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.365206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.392089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.394101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.422065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:39.424533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 212/424] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:39.430314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.442034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e6b5-40d2-4637-b163-e8e5109018cd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.449030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.449910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.450428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.450864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.451830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.452791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.454720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.473682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 213/425] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.480036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.491453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9eb54-a08f-4e24-ba21-b4278e1c3ff4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.503110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.504126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.504580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.505010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.513301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.516239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.542945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 08:27:39.544754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 213/426] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/users/neutron => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:39.551110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.561100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6d8ca-62be-45e5-a9c8-6bdc91c58dec admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.570909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.571838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.572314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.572738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.573846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.574296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.576459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.606530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 214/427] 10.222.0.76 () {56 vars in 1160 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.613412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.624096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6f4b3-1d66-45c7-b4e7-299d234e4472 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.635079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.635937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.636426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.636883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.646757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.648831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.659737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 214/428] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:39.665843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.676879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d501a-54aa-4314-b6c8-b279b4c77e14 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.688383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.689246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.689629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.690004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.701217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.704078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.726123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:39.731778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 215/429] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:39.738730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.748341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1210-ce90-4d0f-8a0e-50a73debaede admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.762793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.763635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.764085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.765073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.765958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.766401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.768148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.780767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 215/430] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.786915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.801350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccccb82-ace2-43d4-b247-255d9c823405 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.806653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.807658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.808094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.808464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.819815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.822223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.837342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:39.839192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 216/431] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:39.846407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.865180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1c786-2d12-42bb-a063-26600bb410ae admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.873163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.874848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.875430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.875931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.876977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.877471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.879588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab4e6-b7ab-49b7-86cf-dc9b4dea979c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.899869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 216/432] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:39.906413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:39.924197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02374511-e292-4dad-a63f-d297f0cf5c17 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:39.935698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:39.937058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:39.937334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:39.937609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:39.938557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=b2d5c942c4e64408b177014981e1e6ab) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:39.938819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:39.940681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d31a1-23e7-41fe-9226-82b613d2a96d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:39.950885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 217/433] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:39 2021] GET /identity/v3/role_assignments?user.id=b2d5c942c4e64408b177014981e1e6ab&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:40.028203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec21af-45fd-42c1-8494-14b5404fc774 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:40.028884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec21af-45fd-42c1-8494-14b5404fc774 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:40.029371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec21af-45fd-42c1-8494-14b5404fc774 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:40.031979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 217/434] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:40.049571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:40.049936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:40.050129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:40.083891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:40.085170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:40.103072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 218/435] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:40.153876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec21af-45fd-42c1-8494-14b5404fc774 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:40.176354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec21af-45fd-42c1-8494-14b5404fc774 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:40.184111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:40.185421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:40.185959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:40.187112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:40.204118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:40.206345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:40.230802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:40.232069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 218/436] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:40.239465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:40.252368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb4ce-1ec7-404b-b7f2-1081116a62c0 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:40.258121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:40.258844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:40.259129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:40.259406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:40.260174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:40.260478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:40.262112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda20c4-5e9a-43b2-9327-e1c54f185b21 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:40.279694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 219/437] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:40.285974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:40.298280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0350-4a71-4737-9931-d5c99c01c308 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:40.304771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:40.305793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:40.306085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:40.306365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:40.307157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:40.309094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121649ad-2148-4d85-bd2d-c4363f4fce4d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:40.336621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 219/438] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:40 2021] POST /identity/v3/users => generated 247 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:41.099482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b29a9-cad8-484d-b03d-8efdc401ff4f None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.099940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b29a9-cad8-484d-b03d-8efdc401ff4f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.100123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b29a9-cad8-484d-b03d-8efdc401ff4f None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.102221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 220/439] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:41.109649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.110160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.110231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.131950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:41.133191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:41.141975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 220/440] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:41.173357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b29a9-cad8-484d-b03d-8efdc401ff4f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.192060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b29a9-cad8-484d-b03d-8efdc401ff4f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.196636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.197435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.197719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.197998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.214711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:41.221881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:41.223508 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 221/441] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:41.229650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.243882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6f7c-5e6f-42f9-be0d-2ce6c3c44523 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.255608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.256782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.257298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.257774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.263203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:41.263773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.267520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.290792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 221/442] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:41.301062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.311708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d9b86-0780-4de9-8353-d5ba33832562 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.322999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.323852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.324145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.324427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.339728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.341613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.373025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:41.374808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 222/443] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:41.385231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.401394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b00175-be11-4bac-8ba5-003ccd4b6136 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.415187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.415869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.416155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.416428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.417184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:41.417484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.419111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.435965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 222/444] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:41.445574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.456743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba86ae-e4fb-43a8-b8d8-939742098f38 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.469542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.469542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.469542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.469542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.488291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.490751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.510388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:41.511663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 223/445] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:41.518197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.532067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe962674-1aca-48e9-abc5-bec54f0725a9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.540990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.541671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.541954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.542233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.543149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:41.543457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.545313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.570641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 223/446] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:41.577406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.592288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b29562-270f-45b0-9f69-571990d4f1a9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.597685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.598527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.598818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.599093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.614948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.616898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.642142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:41.643563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 224/447] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:41.649561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.663611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27062-5f1b-4f07-a0fd-b4195a1a8e65 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.679149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.679831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.680117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.680394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.681144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:41.681455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.683094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.699652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 224/448] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:41.705851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.719622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a9fef-8645-4de0-954b-def66bbb19a1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.726152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.727031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.727315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.727594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.739238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.741292 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.762277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-be300adb-032b-4863-b084-bab203e8aa15 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:41.763622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 225/449] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:41.771062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.787755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571a746-b687-4956-9468-0563ae3de797 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.795122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.796402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.796688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.796965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.798110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:41.798422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.798856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f69a-ee29-4bb5-8f13-21f5ff5c15ce None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.799200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f69a-ee29-4bb5-8f13-21f5ff5c15ce None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.799481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f69a-ee29-4bb5-8f13-21f5ff5c15ce None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.800315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.801324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 226/450] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:41.808938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.809229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.809511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.827031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 225/451] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:41.834064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.851485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d67221-9234-4b5f-b265-55aa5e931c08 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:41.853205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:41.854458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:41.861786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:41.862995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:41.863278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:41.863553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:41.872286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 227/452] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:41.892037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=1a17f0cdeb07409f8439829dc145d5fc, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:41.898816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e153-1844-4da5-93e6-6e68c87f1eaf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:41.915912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 226/453] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:41 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:41.928286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:41.938953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bdc7-f367-46d9-a2e0-86b72bdcda74 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.002449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bcc4-3ba7-4891-b284-08e4a2a2d2b7 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.002809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bcc4-3ba7-4891-b284-08e4a2a2d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.003038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bcc4-3ba7-4891-b284-08e4a2a2d2b7 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.004974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 227/454] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:42.012395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.012739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.013026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.032934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.033868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.034152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.034483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.047559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:42.051044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:42.056528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:42.067682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 228/455] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:42.071713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:42.078690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 228/456] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.083745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.098874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74125c91-ea0b-412d-a5d2-f8ee49ac356d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.104971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.106476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.107142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.107648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.109362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.109976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.112788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.121243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.130658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 229/457] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.137316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25333bb-a32c-4005-b6eb-3d93a660bf09 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.142094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.144000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.144868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.145153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.145433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.160948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbaf23-6f77-4503-8c3d-30d34a6699d7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.164967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:42.169667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.170478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.170886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.171167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.174750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:42.176401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 229/458] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:42.182705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.183101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.184979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.196002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d730-41a5-4bc9-bfc2-98ed80b23d08 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.203688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.204363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.204643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.204920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.205701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.206008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.207291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:42.207683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.208868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 230/459] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.215176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.219530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 230/460] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:42.225913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.227116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b6973-6efe-4d79-bfec-7ad1e65cc657 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.232753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.233764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.234092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.234906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.235679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.235991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.237192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28ea08-9301-4568-bcfe-2385a959cea6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.238039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.242727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.243614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.243918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.244200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.254444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 231/461] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.259795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.267553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.269432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.279523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c238c-17c4-4ef1-bea7-429f9a57f6fe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.284465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.285279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.285565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.285841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.294478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.296843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.302890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:42.304346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 231/462] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.310392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.312722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 08:27:42.318558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 232/463] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:42.321503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.324887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a52c08-8564-4928-be35-3a538bc60009 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.332924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448dabb8-e796-45e5-9cb9-148a625d1196 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.334713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.335438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.335726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.336005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.336866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.337176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.337558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.338228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.338526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.338823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.339013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.339685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.339996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.342097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.364387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 232/465] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.368348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 233/465] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:42.369696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.371120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.386133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8001d-bb91-4ace-8a2a-8831fd0fdb77 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.391311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.392320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.392606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.392879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.397704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60c1a3-930a-4b5d-9561-e17ea06df5f5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.400925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.403040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.410845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.411804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.412034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.412312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.419936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 08:27:42.422201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 234/466] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.430155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.436814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.440761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.451270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087160-29a0-4d47-baeb-7b06eeb7ac16 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.459419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.460097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.460658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.461157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.463792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.464107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.468402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.474004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:42.476248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 233/467] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:42.482961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.494537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7671687-a7a6-4b15-aae5-e687ed81538a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.499403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.500157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.500445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.500727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.501521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.501828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.502702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 235/468] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:42.508499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.509646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.521701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 234/469] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.526979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bb08d-f96f-4f97-8631-69268d7be672 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.529283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.536830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.537901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.539938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.540427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.551789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1ca27-b454-442f-9320-e1e5ac0bfc2b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.563818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.565069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.565593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.566057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.568281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.570057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.585286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.587753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.606942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:42.617996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:42.618620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 236/470] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.619737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.621631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 235/471] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.629264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.636617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071f01f-fdb3-4844-91b1-91027bb67163 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.644202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72160c-32d0-4efc-8d5b-5a9dfd33c9f4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.649639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.651198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.651489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.651767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.654084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.654397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.656534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.657227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.657508 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.657783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.660000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.660313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.661429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.663748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.685146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 237/472] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.687183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 236/473] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.689628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.692215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.708256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd85c2-ff76-453b-ad21-7383251ae5ee admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.711046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633899f2-66b3-464a-9846-3be1deaf1cd1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.718593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.719540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.719821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.720096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.721932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.722839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.723116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.723669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/97167b82c21643c08543bf5d6323c599/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.731499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.734206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.743182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=97167b82c21643c08543bf5d6323c599, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.745868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc930c7-37dc-4389-b2ab-51d9736d15b1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.748735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8b502987-11eb-4f04-819f-5b3f0a94afc5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:42.750030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 238/474] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:42.751717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb819-1c6c-43a5-b025-add8187debb9 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.752047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb819-1c6c-43a5-b025-add8187debb9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.758796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb819-1c6c-43a5-b025-add8187debb9 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.758796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 239/475] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:42.759926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb819-1c6c-43a5-b025-add8187debb9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.769852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 237/476] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:42 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/97167b82c21643c08543bf5d6323c599/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:42.772111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.772706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.773193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.812697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:42.815314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:42.907089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cb819-1c6c-43a5-b025-add8187debb9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.918218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.918928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.919234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.919572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.921466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:42.922032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:42.925329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:42.940833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 238/477] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:42.946554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 240/478] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:42.959983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.965355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:42.976110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaa7b2-447e-4452-86b0-bd646a79d9b7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.979273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eebc7-953f-4bfe-87c0-0c4ba734c124 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:42.980730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.981534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.981816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.982089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:42.996833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:42.997869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:42.998151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:42.998423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/64c05096a69740909d10c748be820840/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.008410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:43.016340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:43.017881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 241/479] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:43.032730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.036489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=64c05096a69740909d10c748be820840, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.039467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.047351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491a31-a9c6-41a6-b597-bd176dc2225e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.057373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.057750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 239/480] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:42 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/64c05096a69740909d10c748be820840/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:27:43.058912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.059434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.059912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.060917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:43.061984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.063903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.075048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 242/481] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:43.086484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.159945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6feebc0-a61a-4371-9164-fa663eebb7a2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.164744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.165660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.165946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.166218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.179181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.181015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.201200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:43.202558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 240/482] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:43.209609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.220243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272d026-8fab-48ba-98c5-ef611b7e8425 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.229209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.229946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.230233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.230524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.231348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:43.231653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.234011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.252667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 243/483] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:43.259167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.269854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6666-249f-4bae-81ea-4ce57a0383f1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.278712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.279583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.279863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.280176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.289240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.291395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.314420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 08:27:43.315879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 241/484] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:43.321889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.332810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b44c8d-d416-4cab-88f8-156cfd793c0e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.337452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.338129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.338408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.338700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.339566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:43.339869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.341724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.361802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 244/485] 10.222.0.76 () {56 vars in 1160 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:43.368083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.378280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97611f7-b17c-4e54-9698-b8b4f249b5a3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.382813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.383603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.383879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.384149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.396127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.398028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.420988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:43.422607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 242/486] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:43.428835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.439477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad88974-8897-49b6-b33e-2560ba59c91f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.443957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.444632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.444914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.445191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.445953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:43.446255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.447969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.463033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 245/487] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:43.469308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.479123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e288-6853-4ab7-bc56-ff4e84b15b55 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.483828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.484611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.484893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.485165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.492849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.494853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.509187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:43.515092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 243/488] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:43.517379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.530360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03380-0ebc-45be-937e-56023e17afd4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.535520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.536242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.536529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.536858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.537672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:43.538025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.540012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841628-5655-48b6-bb0b-6002bef36858 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.553851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 246/489] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:43.560435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.571802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5dbca-c6dd-4de3-85a9-2c6c0ac8a664 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:43.576509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:43.577992 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.578272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.578566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/b2d5c942c4e64408b177014981e1e6ab/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.602410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=b2d5c942c4e64408b177014981e1e6ab, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:43.605221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f804d-9574-4986-ac3b-7efc17a3b939 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:43.624925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 244/490] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:43 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/b2d5c942c4e64408b177014981e1e6ab/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:43.855592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d279e3-59e9-4a80-9b30-055844729a70 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.855592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d279e3-59e9-4a80-9b30-055844729a70 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.855592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d279e3-59e9-4a80-9b30-055844729a70 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.855592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 247/491] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:43.865715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:43.865715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:43.865715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:43.884586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:43.886247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:43.950003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 245/492] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:43.981872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d279e3-59e9-4a80-9b30-055844729a70 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:43.997825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d279e3-59e9-4a80-9b30-055844729a70 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.003411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.004432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.004915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.005381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.017567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:44.025288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:44.030611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 248/493] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:44.034421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.043986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac486f38-01b3-4ae7-8f13-bc32286b358d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.049078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.049910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.050397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.050897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.051825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.052299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.054122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.063812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 246/494] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.070295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.081334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a398f-2e94-43ec-a15a-98ed2bcd0d79 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.086423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.087458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.087890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.088305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.101318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.103480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.127338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:44.134109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 249/495] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:44.135651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.146813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64a7c-da28-4d79-8db7-12ee75b2c782 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.151956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.152882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.153311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.153734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.154724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.156173 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.158078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.171587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 247/496] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.178733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.189960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da0c24-e943-4f22-9e47-d024b565ddd1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.195055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.196078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.196507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.196925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.207240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.209546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.226629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:27:44.232518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 250/497] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:44.235905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.246840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f77a2-412e-495e-8cc8-2f958f5a7fce admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.252845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.253781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.254212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.254730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.255820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.256275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.258366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.284834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 248/498] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.286532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.297411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200900b-5674-4db0-9ff2-a0f3161544f3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.302462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.303292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.303750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.304169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.313847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.315951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.330623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 251/499] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:44.332801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.343144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cbacb-a848-418a-b468-e4629b8b5c41 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.348126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.349128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.349555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.349975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.361728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.364173 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.383316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:44.384772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 249/500] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:44.391960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.401458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85630ff5-f98e-477a-8ad0-2940f9605896 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.406706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.407603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.408087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.408504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.409435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.409985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.411816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.424660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 252/501] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.431093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.442134 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe346e-b6e1-4a51-91ee-1beae90b81cc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.451183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.452891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.453515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.453969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.461983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.464255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.478579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:44.485646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 250/502] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:44.487440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.497889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c8cfa-76bf-49f0-8669-107201f292c0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.503726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.504613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.505128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.505544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.506636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.507106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.509203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6e0d2-065c-4848-a0cb-4eb3a8ca7af2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.526596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 253/503] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.530129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.541279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394813-b7cd-4f72-b696-65390d0f0bc5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.552152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.553068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.553499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.553971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.555021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=18cea006ecc24067ac542e3944ad7a9a) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.555558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.557627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ace5-c3a3-45c4-820c-a7474ef9fb9a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.571007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 251/504] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/role_assignments?user.id=18cea006ecc24067ac542e3944ad7a9a&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.722068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f531f-be10-4d4e-af4c-c0c32a1c7f5f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.722267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f531f-be10-4d4e-af4c-c0c32a1c7f5f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.722563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f531f-be10-4d4e-af4c-c0c32a1c7f5f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.724358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 254/505] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:44.730757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.731191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.731577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.751830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:44.753223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:44.761459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 252/506] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:44.787405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f531f-be10-4d4e-af4c-c0c32a1c7f5f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.800508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f531f-be10-4d4e-af4c-c0c32a1c7f5f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.805273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.806309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.806724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.807158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.819334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:44.827432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:44.828847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 255/507] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:44.835904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.846059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb07c7-d0cd-4066-ad12-0cac87c66dc1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.851050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.851921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.852312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.852696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.853584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.853999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.855831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.874296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 253/508] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:44.880984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.894457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16e94-3831-4257-ba27-e41a34e2cf66 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.901842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.902908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.903381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.903761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.927424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.929684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:44.956602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:44.958345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 256/509] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:44.964703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:44.975542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877d89-df2f-4fbd-8fc8-b8123afb45b6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:44.983771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:44.984631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:44.985020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:44.985404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:44.986353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:44.986789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:44.988824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.002597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 254/510] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:45.009006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.020286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df83a9-ba1e-418a-95f3-9e9fd957f343 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.025208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.026170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.026620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.027005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.035822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.038066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.053039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:45.054652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 257/511] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:45.060805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.072409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6ec99-c02d-4d40-9080-86a6162db17d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.077306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.078142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.078554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.078975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.079991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:45.080426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.082456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.103280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 255/512] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:45.110090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.120256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dace5ce-e233-4669-ae92-c4d7a91850bb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.126071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.126876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.127267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.127680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.136242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.138138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.148388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 258/513] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:27:45.154592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.164771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b25ee-cfd1-4387-865b-25c26278dc16 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.169493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.170396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.170882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.171265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.182591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.184473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.202540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:45.204065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 256/514] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:45.210213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.220079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15feaca-69e6-4366-bceb-be69bbacb879 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.224807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.225467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.225854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.226121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.226906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:45.227527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.228843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.241291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 259/515] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:45.247401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.257990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e215-9f0d-470a-805e-99b2ad6094e4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.262728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.263566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.263849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.264124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.272059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.274086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.292855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:45.294062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 257/516] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:45.303970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.315471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb97e5e-d621-47d9-bee8-e0c43a91456c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.320387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.321055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.321384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.321670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.322484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:45.322820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.324778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e4517-9da1-4d8a-96f0-49a957960822 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.343681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 260/517] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:45.350017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.362102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466787b-f6df-4038-84b4-a2881c5b3824 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.366849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.367555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.367836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.368118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.369028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:45.369336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:45.371276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a892560-2ed4-4112-b27b-568ad718e323 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:45.378811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 258/518] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:45.884676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d997-4f5d-4b9e-82a7-8452df3db00c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.885113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d997-4f5d-4b9e-82a7-8452df3db00c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.885403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47d997-4f5d-4b9e-82a7-8452df3db00c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.887494 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 261/519] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:45.894097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.894365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.894668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.915447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:45.916637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:45.927931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 259/520] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:45.953893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47d997-4f5d-4b9e-82a7-8452df3db00c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:45.967962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47d997-4f5d-4b9e-82a7-8452df3db00c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:45.972561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:45.973354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:45.973637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:45.973909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:45.986197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:45.993737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:45.995312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 262/521] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:46.002859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.012270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78818a8-1c70-4ad8-b0f5-2402aece19a5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.018124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.018791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.019076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.019353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.020128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.020432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.022106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.031331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 260/522] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.037432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.049366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b722da-770f-4ec3-931c-a7afe2bc95b2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.054046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.054937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.055221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.055550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.068424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.070279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.092806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:46.094550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 263/523] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.101477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.112914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f41bf4-79b3-4443-b5fb-45e253cb6d22 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.118300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.119063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.119344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.119618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.120436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.120739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.122483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.136702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 261/524] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.142709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.153058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751dce-c381-4036-b94e-d22a55eb1d29 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.158664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.159524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.159802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.160075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.168951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.171855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.186576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 08:27:46.188134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 264/525] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.194239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.205264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a11d6d-3b3c-48ba-9107-faff14652786 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.209908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.210658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.210952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.211233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.212160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.212467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.214432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdc1bd-ed89-4a8f-b1af-1ea15522fd23 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.234132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 262/526] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.240640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.251308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19a0ee-4fd6-41b3-9a0e-45cc31c8b47d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.256953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c05a6-7a91-4d8a-a5a9-59b200ff1ef5 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.256953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c05a6-7a91-4d8a-a5a9-59b200ff1ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.256953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c05a6-7a91-4d8a-a5a9-59b200ff1ef5 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.259855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.259855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.259855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.259855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.260160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 263/527] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:46.272718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.273211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.273595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.274141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.276184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.292774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 265/528] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:46.293740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:46.299096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:46.303933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.309667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 264/529] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:46.315003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d844a-5a9a-4a8e-aa68-65d10c027342 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.320516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.321496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.321776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.322049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.334464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.336326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.353869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:46.355376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 266/530] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:46.355547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.370220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603a592-022f-4d31-a135-0502b29392c4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.373076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.376361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.377249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.377605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.377966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.389172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:46.389935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03260e-7ba3-4a86-8380-80ef2824469c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.397226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:46.398507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.398900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 265/531] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.399204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.399491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.399766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.400510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.400819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.402410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.405780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.416204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5f5c-3a3c-4bc1-81a1-ef63f8a52274 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.427183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.428211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.428707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 267/532] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:46.429252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.429750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.434775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.435411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.437871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.448125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 266/533] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.451047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.457979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.464078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6dd05-31e5-4601-ac4e-df9fac35b0ec admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.472313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.475653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.476159 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.477111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.482473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c7d8-7293-49b8-a15a-5fb187b17750 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.492379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.493580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.495407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.496820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.497379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.497887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.519483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.521629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.523083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:46.529454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 268/534] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.530354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.540873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:46.542379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 267/535] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.552258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d6a6-173a-45be-9c25-5ed8301e9d5a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.553530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.560603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.562001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.562385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.562733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.563576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.563893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.565978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.566353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3681f30-48d6-43f9-83c1-bd54f05c0b44 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.571442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.572465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.572983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.573462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.574437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.575002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.578017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.591439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 268/536] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.598244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.599701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 269/537] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.603349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.616791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea39b0d-a88d-4234-a505-37af0fdda652 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.621943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.622158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317412f7-f92a-46dc-916e-7264611370fa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.623416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.624676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.625164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.633838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.636089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.636531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.636749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.637032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.637304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.638162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=97167b82c21643c08543bf5d6323c599) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.638472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.640723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.652683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 270/538] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/role_assignments?user.id=97167b82c21643c08543bf5d6323c599&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.653523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 08:27:46.655732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 269/539] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.662582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.680361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e3745-e56e-4b16-b9b1-fb2d41bc2f3c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.691718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.692473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.692759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.693091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.693983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.694346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.696412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77033b1-3fb1-40b0-8fab-8b2f0181efc2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.730611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 271/540] 10.222.0.76 () {56 vars in 1158 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:46.738085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.755824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc931-ff2a-48ea-a2ef-8eaa55cdde21 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.756165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc931-ff2a-48ea-a2ef-8eaa55cdde21 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.756404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc931-ff2a-48ea-a2ef-8eaa55cdde21 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.756577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2572-01de-41aa-bd9a-ebf08dcd4a84 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.758450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 272/541] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:46.767016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.767687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.767817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.768013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.768106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.768299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.768397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.777365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.779315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.794857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 270/542] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:46.801748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.807208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:46.808544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:46.815879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266908e-6850-41fc-a258-7a38b328aeff admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.824523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 273/543] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:46.826391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.827958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.828335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.828674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.840916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.843563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.858899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.868923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:46.869345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360198f-dede-41df-bb20-5947edf10f19 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.870578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 271/544] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:46.877645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.880043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.880930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.881216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.881492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.892779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cbd0f-0ab5-4e16-b932-a183909accb3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.893945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:46.901201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.901592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:46.902019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.902406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.902822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.903194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 274/545] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:46.903749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.904128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.906624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.910417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.921581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 272/546] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:46.934117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c625-2102-4b62-aa7c-e4732221e47a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.934440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.939323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.940011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.940295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.940584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.941362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:46.941666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.943382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.949908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98654228-3e65-468f-8466-5c8cf40ababf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.953909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 275/547] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:46.960672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.960977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:46.961486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.961771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.962193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.972832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83452-2ef4-4b17-8f74-09f3ec16d18b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:46.977680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:46.978488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:46.978797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:46.979071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:46.984091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.986323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:46.991328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:46.993187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.007854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:47.009327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 273/548] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:47.017692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.020593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:47.022131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 276/549] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.028458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.031867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269a605-38c2-4e9f-b2bd-6da56121237d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.036599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.037256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.037541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.037819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.038667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.038979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.042035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.048187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33d5a1-27d0-416a-8106-36673006aea3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.054542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.055406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 274/550] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.055587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.056035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.056505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.057506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.057959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.059932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.062082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.072820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd3dd7-c7b4-4177-be3f-55abcd1ac4e0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.082124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 277/551] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.083235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.084424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.085094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.085377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.085652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.086520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=64c05096a69740909d10c748be820840) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.086837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.088697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.099722 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 275/552] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/role_assignments?user.id=64c05096a69740909d10c748be820840&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:47.102279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbcc51-b5b7-4c95-8084-1ea56de058d5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.107332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.108376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.108772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.109161 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.120395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.122734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.138606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 08:27:47.140593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 278/553] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.147214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.157966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94f47d-5b8a-4762-b9e5-d1e7e2e51cd4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.162763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.163438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.163777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.164053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.165015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.165453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.167623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.190653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 276/554] 10.222.0.76 () {56 vars in 1160 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.197233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.212908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f358b-7abf-4261-82b0-3bf7e7875026 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.218646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.219482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.219876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.220259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.229480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.231523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.244464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 279/555] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:47.251595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.269752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875819c7-1a83-43b4-99ff-bbadecf55816 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.277881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.279502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.280110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.280731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.301818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.305733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.340871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:47.343223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 277/556] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:47.350281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.363086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b54ee-69e0-4c8f-b8fb-5d93b3774343 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.369876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.370845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.371241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.371703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.372650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.373074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.375674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.391009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 280/557] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.396897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.410018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b986f8-56a2-41f6-b45c-0539289273a3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.415249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.416048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.416329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.416606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.431864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.433865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.450576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1246d9b6-1cd6-49bb-9058-5164a43859be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:47.452676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 278/558] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.458912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.471690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43cc53-4f01-4a01-a4ea-fc9be8c2689e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.487342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.488308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.488701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.489130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.490080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.490573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.492786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.506602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a86a-1ee2-4087-bbb2-cce8e9959732 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.506881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a86a-1ee2-4087-bbb2-cce8e9959732 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.507157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9a86a-1ee2-4087-bbb2-cce8e9959732 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.509209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 279/559] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:47.512538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 281/560] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.515922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.516211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.516488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.519331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.540471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c51de0-9562-479b-9677-e42920531a35 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.549664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:47.550962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:47.551748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.552520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.552813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.553091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.553956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=b2d5c942c4e64408b177014981e1e6ab) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.554269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.556168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.567108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 282/561] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/role_assignments?user.id=b2d5c942c4e64408b177014981e1e6ab&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:47.578645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 280/562] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:47.603816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.618448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5957-7a0a-45ab-8687-7c3196b033a4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.627295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.628186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.628474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.628808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.651812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:47.659149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:47.660589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 283/563] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.667677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.683921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79437d-132c-47bf-8fe1-21bef1cda360 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.695155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.695849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.696135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.696416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.697222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.697528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.699353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.713302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 281/564] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.721120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.737002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff75180-02f5-4d26-930d-6b2aa7233bad admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.746794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.747759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.748152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.748590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.765800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.767862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.797281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:47.798736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 284/565] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.805612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.820597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e250ac-a6ae-41e3-8d23-64aa3eef86f3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.830344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.831067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.831351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.831628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.832390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.832693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.834312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.856287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 282/566] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.863259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.873438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3c5f8-6ee0-486e-9f1d-35b1031ed9e2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.882321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.883289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.883713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.884098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.892411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.894755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.913030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:27:47.914680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 285/567] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:47.921397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.936748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2ca1c-a89f-40a4-a6e2-e2cfd57754d9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.946668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.947340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.947623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.947901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:47.948791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:47.949075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:47.950952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:47.969692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 283/568] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:47.975634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:47.985972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a6e0-d573-4032-8d3a-a5c297eb81d3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:47.991414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:47.992390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:47.992784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:47.993206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.005546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:48.007678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:48.028492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:48.029935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 286/569] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:48.036235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:48.048554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb523329-acd8-4abd-a0f7-66da0d4a956d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:48.054143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:48.055147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.055671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.056148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.057138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:48.057681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:48.059676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:48.074687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 284/570] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:48.082619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:48.097831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726041c-91e5-4d88-94b9-dcea87e71679 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:48.106804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:48.107616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.108047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.108346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.121021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:48.123043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:48.141954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:48.143250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 287/571] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:48.149854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:48.163605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0be0e-d3cb-48f2-aa17-0e88af653f3b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:48.171728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:48.172566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.172956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.173340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.174324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:48.174764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:48.176820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8f50-2fb5-4498-8f5d-fd4ef7f77fea admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:48.198069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 285/572] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:48.205081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:48.224589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9003e-bb47-4b59-9606-414455ba8715 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:48.235254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:48.236192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.236479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.237005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/18cea006ecc24067ac542e3944ad7a9a/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.260975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=18cea006ecc24067ac542e3944ad7a9a, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:48.263725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378976d-1ed0-43c9-93be-312175b6b094 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:48.280290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 288/573] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:48 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/18cea006ecc24067ac542e3944ad7a9a/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:48.899582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfefcd-9266-4a96-be9d-7833ccf44a04 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.900108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfefcd-9266-4a96-be9d-7833ccf44a04 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.900108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cfefcd-9266-4a96-be9d-7833ccf44a04 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.902247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 286/574] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:48.908871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:48.909173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:48.909436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:48.932516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:48.933737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:49.014417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 289/575] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:49.049507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfefcd-9266-4a96-be9d-7833ccf44a04 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.068267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cfefcd-9266-4a96-be9d-7833ccf44a04 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.074933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.075766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.076051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.076332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.088207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:49.098517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:49.098517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 287/576] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:49.103974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.118580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9c5db-c0dc-4b45-8ebd-d71d4a8f6f29 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.132117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.132805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.133090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.133371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.134152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.134460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.136113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.153338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 290/577] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.159057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.173212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f3e1f-0e04-41b3-bd93-e8c7153b0f75 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.182908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.184005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.184492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.184967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.204664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.207273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.225232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:49.227133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 288/578] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:49.233553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.248308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ff0aa-fc97-4b81-806e-80d895e41a2e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.264675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.265411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.265673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.265904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.266704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.267000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.268653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.288676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 291/579] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.294812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.309440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0206a-f032-4978-b32e-e2148b6e3555 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.315077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.316202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.316738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.317218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.326641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.329345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.344883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:49.346957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 289/580] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:49.354558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.369038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c526ca4-9f52-43fa-91fc-3727366edd97 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.383738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.384427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.384722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.384999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.385873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.386184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.388086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.413262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 292/581] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.419162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.432985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195e9b-88dd-4ea2-b384-a31d5f2ef64b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.441507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.442298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.442606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.442966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.458214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.460077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.476344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 290/582] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:49.482560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.496780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659eb45-c97c-487e-a09d-187d57c72c62 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.503402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.504259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.504547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.504825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.519937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.521905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.543277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:49.544684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 293/583] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:49.550744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.559979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669e0d-78a3-4fd6-87d5-61d4846176a1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.566193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.567090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.567377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.567709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.568507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.568810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.570474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.587549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 291/584] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.593598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.605536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865a2c3-95b8-4a93-92f7-39f4c2801685 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.613731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.614574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.614914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.615194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.624749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.626816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.644854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:49.646423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 294/585] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:49.652334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.663877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6308fb-c397-4d33-9dcc-74097798110c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.670101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.670970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.671256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.671613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.672432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.672742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.676530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836706c4-7ad2-465e-951c-1e7eb8fe72da admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.692602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 292/586] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.699272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.715692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b7a0-42ba-47da-a094-8038ce4991ca admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.727817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.728501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.728786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.729061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.729925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:49.730234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.732132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8220b-592f-4883-90f4-6e997b2ad0e3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:49.743370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 295/587] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:49.850091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39fbc-e8de-4cfe-984f-755ebad72b54 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.850425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39fbc-e8de-4cfe-984f-755ebad72b54 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.850729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f39fbc-e8de-4cfe-984f-755ebad72b54 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.852741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 293/588] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:49.859684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.860000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.860239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.887814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:49.889126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:49.897980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 296/589] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:49.940410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a502b8-1f4f-4f4d-b3d0-f4aa24faf510 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.940410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a502b8-1f4f-4f4d-b3d0-f4aa24faf510 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.940410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a502b8-1f4f-4f4d-b3d0-f4aa24faf510 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.941332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:49.943812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 294/590] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:49.950463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.951146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.951763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.954154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514a49d-1fc6-4c1c-94d9-5fe3005c82fc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:49.962657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:49.963490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:49.963777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:49.964055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:49.974202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:49.975849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:49.985010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 295/591] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:49.990401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:49.990401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.017545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:50.019288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 297/592] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:50.025308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.027967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.036815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed891-e8b9-41e4-b1c4-6df28abac662 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.042656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.043395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.043730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.043933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631f171-6335-415e-b4ee-1d663347aa0c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.044313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.046747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:50.047065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.048836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.060024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.060876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.061734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.062355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.062938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.063998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:50.063998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:50.063998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:50.064920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.065687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 296/593] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:50.071491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.082950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62864345-77d4-43a9-ac33-05e35612de35 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.085092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 08:27:50.087998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.088731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.089013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.089344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.090084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.092229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.094405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 298/594] 10.222.0.76 () {56 vars in 1150 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:50.100926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.116609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409bc78-f835-4acc-99ce-82ae38770a2a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.125751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.127809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.128109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.129287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.130537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:50.130859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.132652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:50.132652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:50.132652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:50.133467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 297/595] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:27:50 2021] POST /identity/v3/users => generated 254 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:50.134195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9c183-8c3c-4d53-880e-7ceafaf223fd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.140579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 299/596] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:50.146891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.164425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627b08b-6eb6-4b33-a86d-1c33a851959d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.171212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.171905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.172232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.172503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.173351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:50.173657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.174765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:50.174765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:50.174765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:50.175666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4abacd-1c12-474f-b806-3e2d911a9faf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.189754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 298/597] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:50.742816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64985b-c66e-43d0-9ce6-758a45e3ac05 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.743542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64985b-c66e-43d0-9ce6-758a45e3ac05 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.743542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64985b-c66e-43d0-9ce6-758a45e3ac05 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.745441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 300/598] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:50.765471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.765930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.765930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.795648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:50.796883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:50.804838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 299/599] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:50.844306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64985b-c66e-43d0-9ce6-758a45e3ac05 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.860131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64985b-c66e-43d0-9ce6-758a45e3ac05 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.870820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.871636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.871922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.872218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.872918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.874594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.890456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 08:27:50.897202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 301/600] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:50.898632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.908794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2d74f-9347-4651-a992-c578fc9e247f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.913531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.914201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.914484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.914792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.915533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] RBAC: Adding query filter params (name=network) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:50.915839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.917480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f62031-8576-4fce-9d53-de39a5f75ddf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.922655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 300/601] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services?name=network => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:50.928804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:50.940269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2a42b-07de-4712-a1df-6a63b300beb8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:50.944906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:50.945580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:50.945864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:50.946142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:50.946911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:50.947222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:50.948827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693051-3438-40a8-8885-af271bc2963f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:50.962688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 302/602] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:27:50 2021] GET /identity/v3/services?type=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:51.317909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3b08-c237-452f-8cba-577e7efc6e17 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.318971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3b08-c237-452f-8cba-577e7efc6e17 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.319495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3b08-c237-452f-8cba-577e7efc6e17 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.321838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 301/603] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:51.328633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.328929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.329213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.351502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:51.352631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:51.368794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 303/604] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:51.407626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d3b08-c237-452f-8cba-577e7efc6e17 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.425352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d3b08-c237-452f-8cba-577e7efc6e17 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.433033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.433895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.434219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.434551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.449030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:51.457165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:51.458752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 302/605] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:51.465735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.485316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11202464-df5b-4f4f-ad1e-c2471f66f82d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.490138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.490841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.491126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.491402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.492177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:51.492481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.494081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.510773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 304/606] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:51.517344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.531998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d326f5-e18b-4a26-9c6d-ba51cd73a896 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.538744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.539808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.540298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.540775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.558999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.561252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.588804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:51.590380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 303/607] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:51.597222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.612011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e077-4db8-4a0b-bccc-c7f76e6a4eba admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.616484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.617155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.617440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.617718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.618533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:51.618848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.620450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.641017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 305/608] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:51.648815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.659988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf2b4-fb49-4fcc-ae4b-5ee4a87c06c4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.670845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.672057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.672564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.673063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.687557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.689947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.714317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:27:51.715906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 304/609] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:51.722287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.740995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fc285-2480-4ce8-90cb-e28ccdd3da06 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.745565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.746233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.746535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.746818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.747687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:51.747994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.750456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.786362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 306/610] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:51.792262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.807608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802417d-bcc1-4c89-a714-d00694920b58 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.813469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.814397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.814918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.815395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.831884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.834078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.844512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 305/611] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:51.850896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.869353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e9323-0870-44a6-8e69-19a1ccf24c6c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.874572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.875382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.875668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.875941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.895726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.897594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.920993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:51.922655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 307/612] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:51.929739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.939864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6438a8b-2282-44d5-8ef9-6d86e8e5a9b2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.944793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.945707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.946194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.946717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:51.947663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:51.948167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:51.950103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:51.963832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 306/613] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:51.970209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:51.983656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bd1a0-5051-44ac-b3d8-4f1c58e14e4d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:51.988519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:51.989335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:51.989619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:51.989897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.007748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.010214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.026683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:52.027916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 308/614] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:52.034425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.047994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c2ea-d91e-440e-b685-79145eb441a1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.052957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.053866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.054353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.054860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.055864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:52.056372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.058462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252b2b-9e7c-4e04-9508-8a70ad37b462 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.072367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 307/615] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:52.081006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.095893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7fde2-08a2-404f-8a51-8ab56f83399d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.100468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.101136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.101416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.101690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.102618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=18cea006ecc24067ac542e3944ad7a9a) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:52.102936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.104842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58fcf-627d-498f-aec4-73d529bd4459 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.120386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 309/616] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/role_assignments?user.id=18cea006ecc24067ac542e3944ad7a9a&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:52.547048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f641-2ecd-4dba-808d-edbd4b702993 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.547537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f641-2ecd-4dba-808d-edbd4b702993 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.547537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f641-2ecd-4dba-808d-edbd4b702993 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.549715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 308/617] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:52.555802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.556097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.556380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.577400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:52.578720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:52.590678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 310/618] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:52.615488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308f641-2ecd-4dba-808d-edbd4b702993 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.629437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308f641-2ecd-4dba-808d-edbd4b702993 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.633947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.634792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.635080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.635359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.648359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:52.656975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:52.662614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 309/619] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:52.666620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.682615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cae79-3e86-4938-a37f-a106ceac3e15 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.692638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.693726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.694232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.694762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.695757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:52.696273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.698126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.709805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 311/620] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:52.715819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.728732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f366-16d4-45f8-8c76-97a1911f3d34 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.735217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.736131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.736417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.737006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.753380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.755332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.779022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:52.781214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 310/621] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:52.787243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.802284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720323c4-44fd-4347-892c-d5a08071cec0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.808564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.809305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.809597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.809885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.810740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:52.811143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.812824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.829986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 312/622] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:52.836340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.847482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e3017-da76-41f4-b2a1-82de929a1a18 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.852343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.853207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.853533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.853814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.863634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.865989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.883913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:52.885495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 311/623] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:52.892528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.903018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746d9e5-ebdf-4266-9fee-77cb24255f49 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.908660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.909400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.909686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.909966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.910931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:52.911243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.913288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.933477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 313/624] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:52.939775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:52.952754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b838e7c-f686-4a2f-b188-98c56cc2f361 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:52.957865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:52.958748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:52.959035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:52.959316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:52.975790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:52.977742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:52.996120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:52.997676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 312/625] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:53.004097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.015467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c2f10-65a0-42c9-abc9-0a0aa5638268 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.020437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.021118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.021453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.021734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.022565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:53.022973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.024658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.042740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 314/626] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:53.044906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.056045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13603f5-d978-4aa4-a748-01d947c0fc93 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.061142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.061932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.062215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.062568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.070906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.073067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.095463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:53.098404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 313/627] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:53.103711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.115480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4266c-dd95-458f-b7c6-9931c5cb14ce admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.121089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.121784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.122134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.122464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.123492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:53.123810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.125870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503553f-d61c-4a94-b56c-ed10693a2eb5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.141243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 315/628] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:53.147490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.159445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8774d-e860-42fa-8daf-79a9ca5ea6c2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.164300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.165336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.165667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.165950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.168047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=1a17f0cdeb07409f8439829dc145d5fc, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.171013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c6ade-07dc-44d3-8dcb-0783dcc45be0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.189368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 314/629] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:53 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:53.268376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0ff7-8243-449f-aada-a5df512fba50 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.268717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0ff7-8243-449f-aada-a5df512fba50 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.268930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0ff7-8243-449f-aada-a5df512fba50 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.270797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 316/630] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:53.289264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7266-4c4d-4c3a-9cdf-f9237d80736b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.289576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7266-4c4d-4c3a-9cdf-f9237d80736b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.289819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7266-4c4d-4c3a-9cdf-f9237d80736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.315755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-225b7266-4c4d-4c3a-9cdf-f9237d80736b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:53.316934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-225b7266-4c4d-4c3a-9cdf-f9237d80736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:53.393866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 315/631] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:53.430574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0ff7-8243-449f-aada-a5df512fba50 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.456650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0ff7-8243-449f-aada-a5df512fba50 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.470121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.471259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.471828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.472351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.473512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.475069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:53.475069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:53.475069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:53.476480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b5623-c3ee-44af-97db-2cc181f432ea admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.500558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 317/632] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:27:53 2021] POST /identity/v3/services => generated 251 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:27:53.506438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f69d-06e4-4748-b23b-f4ad33dca909 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.506785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f69d-06e4-4748-b23b-f4ad33dca909 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.507051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f69d-06e4-4748-b23b-f4ad33dca909 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.509149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 316/633] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:53.517142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.517832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.518532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.541696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:53.543418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:53.575419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 318/634] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:53 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:53.603495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f69d-06e4-4748-b23b-f4ad33dca909 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.622894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f69d-06e4-4748-b23b-f4ad33dca909 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.635400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.636226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.636506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.636778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.656706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:53.663869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:53.665469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 317/635] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:53.672352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.682740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d0f42-8bb5-4e06-9da4-f546ec6acc67 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.695214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.696310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.696835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.697341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.698522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:53.699104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.701047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.722876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 319/636] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:53.729720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.747803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e45cb-e1b3-4a65-bed6-f6c0578fd594 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.752728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.753586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.753874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.754151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.766456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.768379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.786082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:53.787749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 318/637] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:53.793766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.804024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e21c5-19e4-4c99-b9f0-33cd0aacb1a2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.809051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.809798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.810173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.810540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.811415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:53.811889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.813466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd2497-d2cd-4614-861b-1fdddd4693db admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.829017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 320/638] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:53.835235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.845950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9865ce-dbc0-4900-99a2-7fcf12d6e2dc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.850701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.851567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.851849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.852126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.857970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37528-b931-487f-a508-1e124330178b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.858309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37528-b931-487f-a508-1e124330178b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.858653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee37528-b931-487f-a508-1e124330178b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.860834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 321/639] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:53.867100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.867396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.867505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.867712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.869559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.884504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:27:53.885727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 319/640] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:53.887918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:53.889875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:53.894542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.898807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 322/641] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:53 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:53.912344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21e731-5a6d-4383-b536-a6ad03509ec3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.918674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.919348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.919632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.919905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.920881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:53.921191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.923097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.931545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.943107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae85f-4678-4525-b997-794091b5565c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.948671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.948845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 320/642] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:53.949345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.949628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.949908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.950698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:53.953126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:53.955690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:53.966558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fced75-61a4-419e-b94f-e25d55e28884 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:53.970355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 323/643] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:27:53 2021] POST /identity/v3/services => generated 240 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:27:53.985338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:53.986163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:53.986545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:53.987217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:53.997375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.000544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.012097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 321/644] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:53 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:54.020517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:54.043760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf8915-9157-4ff6-88a2-15ffe2738bd8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:54.052903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:54.053728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:54.054017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:54.054298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:54.070084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.071998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.114483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:54.116172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 324/645] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:54.122239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:54.141203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797df4b-66eb-4fd3-b502-15a315ef5840 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:54.146619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:54.147352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:54.147638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:54.147914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:54.148674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:54.148980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.150641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.169206 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 322/646] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:54.175843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:54.188067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b42d83-28da-4d4d-a6d2-25eca5168d36 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:54.204554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:54.205530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:54.205821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:54.206100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:54.218521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.220571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.241178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:54.242465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 325/647] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:54.249547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:54.263556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95b284-6765-4eb8-89a9-795d9cd6904d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:54.273691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:54.274561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:54.274948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:54.275228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:54.276051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:54.276356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.278204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34e36-a95e-4a28-88ef-97c397bb55a3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.298105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 323/648] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:54.304538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:54.315938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41694eb-3dd0-4b6a-b62b-ebc4a08148e4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:54.320614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:54.321264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:54.321591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:54.321821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:54.322778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=bfa6e1051d6d4779acc95a619cc9ee39) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:54.323098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:54.324959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e20dc-caef-4e1f-8641-bd538d843039 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:54.332899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 326/649] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:54 2021] GET /identity/v3/role_assignments?user.id=bfa6e1051d6d4779acc95a619cc9ee39&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:55.659223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a30d0-300e-4960-8c39-79e418d6c325 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.659935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a30d0-300e-4960-8c39-79e418d6c325 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.659935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a30d0-300e-4960-8c39-79e418d6c325 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.662171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 324/650] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:55.668512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.669062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.669062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.695549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:55.696828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:55.705447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 327/651] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:55 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:55.752389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a30d0-300e-4960-8c39-79e418d6c325 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:55.770158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a30d0-300e-4960-8c39-79e418d6c325 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:55.780007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:55.780865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.781149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.781429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.793097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:55.800883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:55.802155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 325/652] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:55.809424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:55.819519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d28d8d-67d5-4137-9bf1-57b2d5b845ca None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:55.830483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:55.831259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.831597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.831884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.832689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:55.833000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:55.834685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:55.844782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 328/653] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:55.851047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:55.862294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815c9d9-a5ac-4bfe-9945-a9eb90511503 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:55.870212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:55.871076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.871384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.871705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.889754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:55.891773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:55.913138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:55.914312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 326/654] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:55.920927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:55.931481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af9f0a-7b19-4982-b9bb-1d8792c226c5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:55.939625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:55.940368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.940689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.941020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:55.941781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:55.942163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:55.944075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:55.962730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 329/655] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:55.970120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:55.980268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118860d-c851-4c3c-8a71-ad8b33667054 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:55.987905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:55.988758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:55.989079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:55.989370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.001822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.003948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.022345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:27:56.024111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 327/656] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:56.034211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.044960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9381-e0ad-4104-a65f-51de6ab19574 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.053786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.054809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.055215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.055592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.056778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.057201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.060170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.105395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 330/657] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:56.111965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.126275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4e7f8-bfb5-4529-8666-516776e39e59 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.134235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.134963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.135298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.135600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.149354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.151247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.164767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 328/658] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:56.171517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.188419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4c257-db94-44f7-9e9e-bd7a149185aa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.199206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.200024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.200308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.200587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.218954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.220862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.252584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-d1fc8a5b-ad2c-415f-9281-0c2ab09100e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:56.253875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 331/659] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:56.260465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.276136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327800d-cc27-4f72-b7c6-f9b23c6d6026 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.283618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25545d-e1f4-40c0-b2db-6d8bccb1f7f2 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.283914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25545d-e1f4-40c0-b2db-6d8bccb1f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.284194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25545d-e1f4-40c0-b2db-6d8bccb1f7f2 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.285973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 332/660] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:56.291060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.291739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.292095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.292372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.293162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.293485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.295848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.303500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.303781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.304062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.327741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 329/661] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.328739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:56.330017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:56.332617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.344730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa971-1447-44f9-8421-3d9cd182abe9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.352079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 333/662] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:56 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 28 08:27:56.359387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.360196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.360480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.360758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.373880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.375931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.379436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.396521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:56.397051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6792f7-403e-4fa9-82c2-50d47844e9bc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.398124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 330/663] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:56.405195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.409102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.410289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.410812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.411294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.416211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fb368-180b-4046-9040-26814cdbf7ac admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.421616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.422357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.422717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.422995 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.423870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.424180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.426540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a5727-0238-495b-8a30-d7f42a9a9185 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.440767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:56.445024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 331/664] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:56.446450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c472f-4128-47df-9d22-35e9782de5fe None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.446771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c472f-4128-47df-9d22-35e9782de5fe None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.447056 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c472f-4128-47df-9d22-35e9782de5fe None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.447892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-472cb5d1-f3b3-4f2c-bb67-0528f2c73d38 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:56.448775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 332/665] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:56.449843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c472f-4128-47df-9d22-35e9782de5fe None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.454483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 334/666] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:56.455977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.456269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.456604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.463102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c472f-4128-47df-9d22-35e9782de5fe None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.468434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.469194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.469482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.469762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.470718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=18cea006ecc24067ac542e3944ad7a9a) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.471034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.473021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.476472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:56.477689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:56.479930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 333/667] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/role_assignments?user.id=18cea006ecc24067ac542e3944ad7a9a&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:56.480767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.488641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 335/668] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:56 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:56.496907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d41e2-6048-4f29-84fa-8b9a4078e49d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.514975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.516021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.516733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.517028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.517309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.518111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.518441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.520134 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.525469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b12c1-4208-4f02-84d4-efd1e6ebd0cb None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.531595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.532530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.532863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.533143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.533883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.534985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 334/669] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.535726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.541703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.550590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 08:27:56.552283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 336/670] 10.222.0.76 () {56 vars in 1150 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:56.556962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7e501-e9a3-48fe-9e3c-18f11e306f4b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.559692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.571131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc45269-92b5-4394-b7e9-1e48f3a568dc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.571764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.572587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.572872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.573157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.576039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.577439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.577726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.578072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.578924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.579324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.581098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.586952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 337/671] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.594070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.599782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.601725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.605638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390162-24a2-46ff-90e1-eb9bc890ada1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.610936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.611960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.612281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.612594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.613460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.613818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.615749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.622317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 338/672] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.632052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.636969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:56.645069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 335/673] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:56.648021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.654082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af7e6c-0cb3-4b00-8166-225d97533f43 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.667224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.667879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.668997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9bc0f-360a-4a79-b231-2c943709e8db admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.670152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.670658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.672006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] RBAC: Adding query filter params (interface=public, service_id=ad4882778e784bfcac513b998ccc73b8, region_id=RegionOne) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.672361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.675561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:56.675561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:27:56.675561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:27:56.678019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.679419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.680107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.681687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.681972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.686112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.686112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.686112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.691773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 339/674] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/endpoints?service_id=ad4882778e784bfcac513b998ccc73b8&interface=public®ion_id=RegionOne => generated 194 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.703369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.709775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 336/675] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.719459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.722370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d79e5-2d71-4e3a-8676-7e8496e6a6ad admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.730717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.731454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.731738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.732018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.732816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.733250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f8425-052f-4ab3-b254-1649a13deede admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.734487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.748387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.752011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.752726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.753238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.759019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 340/676] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/services => generated 772 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.771301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.774053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.794404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:27:56.796158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 337/677] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:56.802998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.816176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaaaaa3-a9f7-41f0-9ee2-c922802eb2a4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.822882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.824214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.824838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.825329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.827047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:56.827646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.829864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.852982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 341/678] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:56.860214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.873190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25d2c3-dade-45b6-9d8b-d9a43abbbdbb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.879154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.880379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.880891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.881428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.892310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.894693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.906814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 338/679] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:27:56.914079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.926329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf026-ca74-4fb2-a3e4-563ea70f02be admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.932063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.933354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.933879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:56.934362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:56.947627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:56.950071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:56.972017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:56.974014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 342/680] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:56.979962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:56.992242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13751ba1-20b2-4167-903d-d9959de714dc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:56.997368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:56.999124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:56.999737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.000268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.001257 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.001863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.006686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.024015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 339/681] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.030602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.042357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f82db-8388-4f66-b4ad-28073f06fe5d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.048414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.049565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.050080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.050562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.059600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.063045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.097444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:57.099021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 343/682] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:57.105745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.126087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa0a4-95f5-4f02-aacd-719cd0a84ddd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.140293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.140784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.141072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.141353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.143611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.143611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.144492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de3d3c-caa2-4c01-99c1-65a21a1d953d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.161735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 340/683] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.168563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.187732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d5a17-524a-43ff-8119-54c58473679b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.199237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.199916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.200202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.200474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.201398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.202236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.204545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ba654-31f8-4935-b83e-add01eb8dee4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.213280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 344/684] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.225092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74c37-7f18-4eb8-867d-f6f18f53c4da None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.225380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74c37-7f18-4eb8-867d-f6f18f53c4da None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.225659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74c37-7f18-4eb8-867d-f6f18f53c4da None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.227543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 341/685] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:57.234196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3344d-dcfb-448b-90bb-a7a57dec14a8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.234548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3344d-dcfb-448b-90bb-a7a57dec14a8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.234845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3344d-dcfb-448b-90bb-a7a57dec14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.255013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a6e3344d-dcfb-448b-90bb-a7a57dec14a8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:57.256235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a6e3344d-dcfb-448b-90bb-a7a57dec14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:57.267204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 345/686] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:27:57.302538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74c37-7f18-4eb8-867d-f6f18f53c4da None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.326401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74c37-7f18-4eb8-867d-f6f18f53c4da None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.328793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5760d6-a096-4d8d-9a51-8545adae96cc None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.329084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5760d6-a096-4d8d-9a51-8545adae96cc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.329358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5760d6-a096-4d8d-9a51-8545adae96cc None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.331583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 346/687] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:57.334345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.335184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.335466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.335739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] PATH_INFO: `/v3/services/network` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.336431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.337463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:27:57.337463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:27:57.337463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:27:57.338120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.338363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.338547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.338705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.365744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 08:27:57.372398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 342/688] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/services/network => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:57.373962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:57.375462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:57.376451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.393017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 347/689] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:57.398195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f080bf-f6e7-4280-b783-045b3d6011cf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.412375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.413061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.413355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.413618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.414361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.414715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.416449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.425812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 343/690] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:27:57.431736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.437111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.445501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd92f6-cd35-4022-9ec0-8cef1bdda2ab None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.451614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1ebcc-fb0c-45a8-b87c-10d2fe848d5a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.454416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.455481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.456078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.456559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.457587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.458111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.460141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.462189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.463231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.463347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.463578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.468069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 348/691] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/services?type=network => generated 350 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.479052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.479217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:57.487638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:27:57.489260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 344/692] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:57.491205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6127-a7a5-4844-80c2-a9b096aff44e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.496013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.504119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.504785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.505079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.505345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.506155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] RBAC: Adding query filter params (interface=public, service_id=c77133f97ff640d79e8f2a6bad09b802, region_id=RegionOne) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.506467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.508356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.514928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1854-fd15-4ef2-a4e2-0bc788846fb3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.516048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 349/693] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/endpoints?service_id=c77133f97ff640d79e8f2a6bad09b802&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.522486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.526277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.527062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.527347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.527622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.528465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.528696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.530788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.539456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 345/694] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.544194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df43d1-2754-46da-b701-6cd1faf71a88 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.547802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.556361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.557267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.557568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924c40-fba7-4885-a6b7-29d52fb65026 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.557939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.558489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.559676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.562979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.565001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.565943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.566369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.566783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.571112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 350/695] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/services => generated 772 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.583838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.585797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.608169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:57.610254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 346/696] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:57.617293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.629628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08195a-f581-45da-b164-2d008cd22161 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.634623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.635319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.635652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.635928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.636806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.637113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.638960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.655681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 351/697] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.661961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.673586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a1075-bd89-42ab-8d66-f09eb4641c2c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.678418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.679308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.679584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.679855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.693015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.695298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.720009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:27:57.721166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 347/698] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:57.727803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.742123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa01289-71b9-4ba3-854a-7eee1be9a104 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.747445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.748190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.749130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.749470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.750342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.750673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.752671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.778395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 352/699] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.785514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.797249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677df691-3f6e-4b0e-bafa-641a74b858d8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.802549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.803703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.804276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.804779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.818224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.821844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.841165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:57.843674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 348/700] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:57.849822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.869423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ca90-8169-49a4-9f53-b2c738984bc8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.877688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.878436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.878751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.879025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.879868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.880216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.881932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.898866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 353/701] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:57.906176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.918885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a61f7-e9d5-4db8-ba93-0168a04cbc00 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.924682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.926819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.927343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.927834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.936320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.938829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:57.953686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:27:57.955533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 349/702] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:57.964040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:57.976425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025adbdb-13a8-469a-9f56-7b319bed354a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:57.981572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:57.982231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:57.982678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:57.983965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:57.984796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:57.985102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:57.987254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d65438-0429-4171-8bd0-c2dfd488c10d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:58.001624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 354/703] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:27:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:58.007856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:58.018006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe586c19-d83e-4a22-96ae-43b8060bcfc0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:58.022755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:58.023809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:58.024237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:58.024654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/bfa6e1051d6d4779acc95a619cc9ee39/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:58.043032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=bfa6e1051d6d4779acc95a619cc9ee39, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:58.046886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f08e-8bb2-4dfa-949f-4f263c15c6f9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:58.068203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 350/704] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:27:58 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/bfa6e1051d6d4779acc95a619cc9ee39/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:27:59.610033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5f79-fca0-484a-86df-93c7a705db93 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.610948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5f79-fca0-484a-86df-93c7a705db93 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.611371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5f79-fca0-484a-86df-93c7a705db93 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.613802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 355/705] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:27:59.619933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0059e-f46b-4f88-942b-b7a719f03235 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.620364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0059e-f46b-4f88-942b-b7a719f03235 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.620607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0059e-f46b-4f88-942b-b7a719f03235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.647161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1da0059e-f46b-4f88-942b-b7a719f03235 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:59.648456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1da0059e-f46b-4f88-942b-b7a719f03235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:59.729011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 351/706] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:59 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:59.772012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5f79-fca0-484a-86df-93c7a705db93 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.793180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb4-817e-44a9-b418-1f987382bd15 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.793499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb4-817e-44a9-b418-1f987382bd15 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.793807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c7cb4-817e-44a9-b418-1f987382bd15 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.795855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 352/707] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:27:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:27:59.797777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd5f79-fca0-484a-86df-93c7a705db93 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:59.801922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.802204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.802481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.803986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:59.804782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.805088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.805350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.820349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:27:59.828653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:27:59.834612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 356/708] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:59.835523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:27:59.836643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.837029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:27:59.847315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6408-63bf-4902-a9bf-47b97d6053fa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:59.852151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:59.853202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.853736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.854164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.855124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:59.855306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 353/709] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:27:59 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:27:59.855775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:59.857661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:59.873232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 357/710] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:59.875092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.886332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.888608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941083b8-48d1-448f-bea9-b74dedf82ae7 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:59.898068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886322fb-08b8-4346-b58a-85ceb0285bef admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:59.901432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:59.902235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.902541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.902821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.904227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:59.905798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.906295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.906922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.907881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:59.909758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:59.921832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 08:27:59.923721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 358/711] 10.222.0.76 () {56 vars in 1150 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:27:59.924525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:59.926398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:59.936257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.954284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9e20-93b5-4a92-8339-3c5570af57ce admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:27:59.964775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:27:59.968761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:27:59.969470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:27:59.969757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:27:59.970071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:27:59.970826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:27:59.971133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:27:59.972105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 354/712] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:27:59.973558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:27:59.978564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.983756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 359/713] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:27:59.991572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:27:59.994890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef38cf-21df-4e73-8773-07dce74ed02f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.000716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.001696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.002157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.002685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.003677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.004169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.006005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.009652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3680d5-b2b6-4fc1-8e15-5f73163539d4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.020508 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 355/714] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:00.024673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.025419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.025776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.026117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.027110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.027933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.028666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.030906 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.043239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04295c-b033-4951-a730-f64cfa0e84e8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.045577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 360/715] 10.222.0.76 () {56 vars in 1145 bytes} [Thu Oct 28 08:27:59 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:00.051119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.052700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.058139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.059602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.059956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.064910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510886-4bc7-41ca-b85c-3348a2bc9c0c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.082762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.085526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.088120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.088882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.089237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.089590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.096122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.097599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:00.097599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:28:00.097599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:28:00.100220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.117464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:28:00.120983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 356/716] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:00.127493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.140862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 361/717] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:00 2021] POST /identity/v3/endpoints => generated 346 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:00.145979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e01f8-c913-4fc4-9732-cceda4baa1b9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.161989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.162699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.162982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.163254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.164191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.164499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.166488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc9790-f407-42f9-ac1f-5ad49b2135ae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.188303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 357/718] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:00.195821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.213125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8245e88-1fe8-4b57-a8e6-7aec5a8b27cc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.219827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.220695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.220980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.221246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.230800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340d75-51ee-435e-886f-21894316ae68 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.231126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340d75-51ee-435e-886f-21894316ae68 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.231361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340d75-51ee-435e-886f-21894316ae68 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.233930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 358/719] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:00.242201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.245590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.245885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.246333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.253283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.276097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:00.277663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:00.287468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 359/720] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:00 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:00.295498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:00.297176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 362/721] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:00.304133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.315427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.315885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782f1ff-82c6-410e-ab3a-ce1d4fa0c80a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.327515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.328213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.328497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.328775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.329552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.332165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625c4dc-5c39-47a8-9d44-72b196e006ec admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.332878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.334702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.347281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.348210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.348553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.348831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.349524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.351203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.356247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 360/722] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:00.363620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.374614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 08:28:00.375903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 363/723] 10.222.0.76 () {56 vars in 1153 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:00.386593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47af759-b89d-44e0-a558-af8a909fa5fd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.387977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.397102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.397921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.398204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.398485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.409505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.409505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.410079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be5f3c-66fa-4a01-806a-60e748e2e30d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.423314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.424371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.424885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.425366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.425560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:00.426526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.427088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 361/724] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:00.427577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.429503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.433507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.440465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 364/725] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:00.447156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.449759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e417-ce33-4050-8f46-0824bf1d8bf3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.459462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.460215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.460500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.460781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.461732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.462075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.466244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.466726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb778cfa-684f-479f-a2ee-2eed7dbb607d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.479597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.481419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.482101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.483306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.484216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 362/726] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:00.484636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.485211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.488856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816825f1-17d2-4976-ad73-733ee3350857 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.490989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.495113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 365/727] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:00.517012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766db3c-702e-4d42-bb95-c4c1fe504747 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.524127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.525507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.526072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.526652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/18cea006ecc24067ac542e3944ad7a9a/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.529304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=18cea006ecc24067ac542e3944ad7a9a, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.533220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dec93-7402-45a4-8bdf-9f583af98485 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.554120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 363/728] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:00 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/18cea006ecc24067ac542e3944ad7a9a/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:28:00.612515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59244b-2b62-4d4e-92a4-c8a0a67260e4 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.613041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59244b-2b62-4d4e-92a4-c8a0a67260e4 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.613112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59244b-2b62-4d4e-92a4-c8a0a67260e4 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.614935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 366/729] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:00.621812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.622428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.622428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.651893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:00.653072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:00.722585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 364/730] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:00 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:00.751385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59244b-2b62-4d4e-92a4-c8a0a67260e4 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.764962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59244b-2b62-4d4e-92a4-c8a0a67260e4 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.770003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.770966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.771252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.771588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.772297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.774086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.786832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 08:28:00.793919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 367/731] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:00.796368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.806240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bfe1-e915-4f12-af12-95d729215933 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.815181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.815876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.816162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.816436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.817187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] RBAC: Adding query filter params (name=network) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.817493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.819306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.825511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 365/732] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:00.832111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.843754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4286bb-b680-458e-9f1c-9567979261f9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.848397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.849060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.849345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.849621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.850383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:00.850726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.852323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517afe6d-0367-46c1-9f43-edc675d31c5d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.860436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 368/733] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:00 2021] GET /identity/v3/services?type=network => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:00.868035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:00.880252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b68f8-f8e9-427b-88c8-c77705dd89ae admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:00.887221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:00.888140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:00.888589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:00.889075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:00.890021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:00.891356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:00.891356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:28:00.891356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:28:00.892618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45887-c40b-49a2-9c0c-f938dc822c60 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:00.922796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 366/734] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:00 2021] POST /identity/v3/endpoints => generated 327 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:01.090214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34201c-0a04-4f7f-bfa8-7d31fc2493b3 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.090588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34201c-0a04-4f7f-bfa8-7d31fc2493b3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.090807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34201c-0a04-4f7f-bfa8-7d31fc2493b3 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.093573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 369/735] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:01.103464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.104087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.104564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.129349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:01.131042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:01.155729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 367/736] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:01.200754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34201c-0a04-4f7f-bfa8-7d31fc2493b3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.219902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34201c-0a04-4f7f-bfa8-7d31fc2493b3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.225432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.226454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.226882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.227183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.243279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:01.253544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:28:01.255871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 370/737] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:01.262182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.276675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb8ed2-d40c-4333-9e52-e5c965596827 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.282589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.283399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.283687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.284095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.284929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.285310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.288230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.298671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 368/738] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:01.304442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.315958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62647460-1cc1-42e6-93b2-e647fe8531aa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.320912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.322019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.322552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.323063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.334959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.337172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.356297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:01.359118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 371/739] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:01.365183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.387698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbc9da-5e98-460c-97ac-3b364c356e8f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.393196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.393913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.394190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.394549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.395305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.395657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.397321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.411165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 369/740] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:01.416827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.431004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6491a99-3336-4b96-ad9e-8e307b044c64 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.437160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.437991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.438276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.438576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.446880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.449040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.471952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:28:01.473656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 372/741] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:01.480300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.498632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222a746-6e4f-4b7d-82a8-11c42778160c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.504619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.505504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.505927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.506385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.507553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.508026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.510056 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.534432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 370/742] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:01.540819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.551457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65127-73e1-4986-bd88-73b60eba8b76 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.556237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.557023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.557386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.557760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.566631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.568607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.578388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 373/743] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:01.584637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.595724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f7d17-3a84-401f-918d-61a4f4b1b9bc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.600794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.601748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.602135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.602561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.615062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.617137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.636031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:01.637706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 371/744] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:01.644195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.653630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43679-d507-4c55-a8b1-3e785fa06a10 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.659183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.660191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.660596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.660970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.661822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.662272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.663943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.677192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 374/745] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:01.683313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.693700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c56b0-7be1-4547-a15c-f622cb879dae admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.698539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.699551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.699894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.700172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.708765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.710943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.725291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:01.727499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 372/746] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:01.733667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.744102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bed22-777b-4caa-8868-6018689dbadd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.749015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.749914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.750184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.750560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.751392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.751761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.753692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df444bf0-ca41-4646-bce1-c3f8797ffa4a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.767853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 375/747] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:01.774325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:01.786299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9fa99-2fc7-42de-8123-9e38cc8460bb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:01.793178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:01.793852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:01.794139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:01.794421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:01.795709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=bfa6e1051d6d4779acc95a619cc9ee39) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:01.796029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:01.797946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d107652-0f9f-4c5b-8be3-dd543c5ac204 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:01.805248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 373/748] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:01 2021] GET /identity/v3/role_assignments?user.id=bfa6e1051d6d4779acc95a619cc9ee39&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:02.911021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a049-36de-41c9-aa04-ff6bc4f0a47c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:02.911727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a049-36de-41c9-aa04-ff6bc4f0a47c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:02.911727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296a049-36de-41c9-aa04-ff6bc4f0a47c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:02.913649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 376/749] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:02.920342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f469b-2d7d-44b8-bf3b-c17c0a3000da None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:02.920948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f469b-2d7d-44b8-bf3b-c17c0a3000da None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:02.920948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f469b-2d7d-44b8-bf3b-c17c0a3000da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:02.939831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-810f469b-2d7d-44b8-bf3b-c17c0a3000da None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:02.941049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-810f469b-2d7d-44b8-bf3b-c17c0a3000da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:02.949249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 374/750] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:02.973843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296a049-36de-41c9-aa04-ff6bc4f0a47c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:02.987336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296a049-36de-41c9-aa04-ff6bc4f0a47c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:02.991920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:02.992723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:02.993282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:02.993282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:02.993949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:02.994840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05054-3c58-4002-b8eb-88e300f85671 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:02.995132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05054-3c58-4002-b8eb-88e300f85671 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:02.995411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d05054-3c58-4002-b8eb-88e300f85671 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:02.995604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:02.997456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 375/751] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:03.003504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.003785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.004066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.008814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 08:28:03.010607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 377/752] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:03.017860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.022910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:03.024107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:03.028834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f78321-e1ce-4786-9afe-e5aa5ab94e5a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.032937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 376/753] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:03.034676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.035566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.036028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.036487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.037392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.037874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.039788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.045746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 378/754] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:03.052100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.057961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.063895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc563270-db7e-4c46-ba84-c26ee115dd09 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.070171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99343-5ecd-4bf9-b3e3-116ad4f465cc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.072466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.073664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.074840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.075200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.076241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.076807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.078322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.078696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.079540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.080026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.080499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.084898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 377/755] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.099962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:03.107253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:03.109541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 379/756] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:03.117130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.128189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562baf0-8030-402a-a548-890ad23e7f5c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.133235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.133931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.134217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.134514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.135338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.135648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.137341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.148714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 378/757] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.156181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.167043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528b0e7-b28b-49e3-a3ad-a16237bb11d9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.172557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.173384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.173669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.173945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.186042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.188543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.207589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:03.209246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 380/758] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:03.215741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.226744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705b4c3-3915-411a-9f50-2eaf5b68781f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.231677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.232394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.233207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.233485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.234327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.234699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.236423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e1c46-c1b1-43fe-8890-1d0ab9bbb0c4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.249977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 379/759] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.256507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.264268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0d7d-8379-4067-99e4-cec607342da6 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.264580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0d7d-8379-4067-99e4-cec607342da6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.264855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b0d7d-8379-4067-99e4-cec607342da6 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.267094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 380/760] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:03.267764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afb46e-b201-4c1f-8f83-b1f0ac376778 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.272700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.273534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.273738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.273890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.274035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.274178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.274320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.283514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.285713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.293223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:03.294458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:03.302534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 08:28:03.304126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 381/762] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:03.309323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 381/762] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:03.310522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.322453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188e60-e9e4-4af3-8bd7-ae2875c563f8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.327480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.328294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.328579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.328850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.329062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.329730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.330038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.331975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.338338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39ce42-a659-4227-9a08-0317f6e22a2e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.343712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.344522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.344725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.344909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.345655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.346699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:03.346699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:28:03.346699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:28:03.347907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.356594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 382/763] 10.222.0.76 () {56 vars in 1156 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.363153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.374659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 382/764] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:03 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:03.375304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d29f35-3b94-4925-a613-437d8a69a950 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.392371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.393046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.393334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.393615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.403030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.404925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.416183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 383/765] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:28:03.423079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.441301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7baf-dd0d-479c-8764-4517728558f7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.446372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.447395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.447749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.448092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.460732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.462789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.481127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:03.483310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 383/766] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:03.490000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.500188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df588f5-0ab1-41c4-9ea1-de84a97d0635 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.505036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.505743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.506031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.506314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.507118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.507431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.509083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.526637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 384/767] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.529046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.543166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e57c56-d916-442a-bf46-4ca5a024ace9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.549970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.550891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.551177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.551455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.559361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.561950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.577237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:03.582631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 384/768] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:03.585639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.595953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59cf03-653c-430f-b077-11e01dc0cc47 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.600642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.601307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.601593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.601876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.602727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.603039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.604931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455279dd-6d61-4bf9-9809-9f6752078777 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.619772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 385/769] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:03.626406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:03.636641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89c53-e7f7-4251-b19f-cd0f9c59ad45 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:03.641697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:03.642409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:03.642755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:03.643035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:03.643956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=18cea006ecc24067ac542e3944ad7a9a) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:03.644268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:03.646236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda266db-87ba-4e7f-806f-b89ba2b44d6a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:03.656026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 385/770] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:03 2021] GET /identity/v3/role_assignments?user.id=18cea006ecc24067ac542e3944ad7a9a&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.289944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b601a-516d-4ecb-9e04-1c4e891461a2 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.290642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b601a-516d-4ecb-9e04-1c4e891461a2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.290642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b601a-516d-4ecb-9e04-1c4e891461a2 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.292584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 386/771] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:04.298722 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.299304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.299304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.319696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:04.320921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:04.331067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 386/772] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:04.360477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b601a-516d-4ecb-9e04-1c4e891461a2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.373399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b601a-516d-4ecb-9e04-1c4e891461a2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.378085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.378938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.379217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.379489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.392805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:04.400541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:04.402143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 387/773] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:04.409740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.418784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f06856-91f2-4955-9035-eff97e99c273 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.424068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.424777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.425057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.425329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.426103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.426401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.428045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.437943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 387/774] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.444125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.458142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb266865-86ac-4a08-bda7-c3d14a419e91 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.463053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.463851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.464168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.464497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.476614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.478699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.496296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:04.497893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 388/775] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:04.504585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.515885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03db78-1541-4cb1-9305-2fcf237faa89 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.520543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.521194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.521475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.521751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.522505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.522814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.524399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.537511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 388/776] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.543646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.553778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb417e-073d-4367-89d0-c6c4c9fdc157 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.558594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.559418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.559703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.559976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.569636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.571699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.586865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:28:04.588305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 389/777] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:04.594602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.604918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61bb1-56cf-40d8-9dc3-b6e206decbe1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.609731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.610365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.610733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.610958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.612081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.612387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.614245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.633262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 389/778] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.639705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.650141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da302bdf-54a8-47ea-887f-2670bb08eeac admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.655094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.655788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.656073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.656384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.665064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.666943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.677018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 390/779] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:04.683574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.696524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5948c4-076c-4361-bf3c-5e14651e3cfe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.702014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.702994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.703349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.703695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.714768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.716935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.734407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:04.736047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 390/780] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:04.742388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.752332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3730c8-14c5-4e05-8d1e-a96f736d5bd0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.757316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.758200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.758698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.759116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.761054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.761511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.763421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.777360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 391/781] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.783760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.798604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4cd0-e511-4721-b6cf-a739db61a091 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.803758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.804663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.805024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.805515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.813947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.816145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.830689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:04.832410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 391/782] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:04.838579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.849145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559541b9-5587-4ceb-b739-492f8ba503b1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.853966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.854915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.855362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.855779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.856721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.857172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.859742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc03aff-b14c-4c3a-b1b0-028cba029d40 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.874291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 392/783] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:04.881199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:04.898216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31394c-3bd9-4811-aa81-95050b06a6c7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:04.903254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:04.904040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:04.904453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:04.904805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:04.905815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] RBAC: Adding query filter params (role.id=85366a8a1f4e4d4387dcd1b3798c8ae9, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=bfa6e1051d6d4779acc95a619cc9ee39) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:04.906211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:04.908313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e73d21-703c-494b-b1d3-a69e03739ba9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:04.914963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 392/784] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:04 2021] GET /identity/v3/role_assignments?user.id=bfa6e1051d6d4779acc95a619cc9ee39&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:05.542726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846216d-e5eb-46cd-bc9c-b38af12c6730 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.543759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846216d-e5eb-46cd-bc9c-b38af12c6730 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.544275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846216d-e5eb-46cd-bc9c-b38af12c6730 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.546966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 393/785] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:05.553451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6cda-97b2-4d54-bfa4-3fc500022a75 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.553913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6cda-97b2-4d54-bfa4-3fc500022a75 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.554088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d6cda-97b2-4d54-bfa4-3fc500022a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.572674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d40d6cda-97b2-4d54-bfa4-3fc500022a75 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:05.573908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d40d6cda-97b2-4d54-bfa4-3fc500022a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:05.586600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 393/786] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:05 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:05.608349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846216d-e5eb-46cd-bc9c-b38af12c6730 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:05.621605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846216d-e5eb-46cd-bc9c-b38af12c6730 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:05.626618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:05.627287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.627586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.627876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.628651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:05.630351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ed6a0-cf70-4752-b532-842e0aa53c75 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:05.651022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 394/787] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:05 2021] POST /identity/v3/services => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:05.834240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edd9b-3186-4edf-9e94-4fbb0fb1c29b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.834612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edd9b-3186-4edf-9e94-4fbb0fb1c29b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.834888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306edd9b-3186-4edf-9e94-4fbb0fb1c29b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.837057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 394/788] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:05.844741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.845365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.845856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.865434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:05.867051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:05.885889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 395/789] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:05 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:05.912713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306edd9b-3186-4edf-9e94-4fbb0fb1c29b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:05.926240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306edd9b-3186-4edf-9e94-4fbb0fb1c29b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:05.932513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:05.934424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.935168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.936871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.938460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:05.941962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:05.958598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 08:28:05.960662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 395/790] 10.222.0.76 () {56 vars in 1153 bytes} [Thu Oct 28 08:28:05 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:05.968224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:05.978584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a3bb8-e79f-4cfe-8f38-a79b9d18601c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:05.984882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:05.986006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:05.986777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:05.987264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:05.988292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:05.988807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:05.990711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:05.996699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 396/791] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:05 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:06.004303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.015657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071f572-a80a-4cd1-8745-38135752d953 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.020792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.021739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.022262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.022782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.023748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:06.024260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.026185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.032764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 396/792] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:06.039599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.051179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8e486-1182-4d5d-b5d8-f634e42b6b7f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.056278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.057239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.057718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.058185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.059320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] RBAC: Adding query filter params (interface=public, service_id=4ec5c6d025e04a0487734943446dec4e, region_id=RegionOne) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:06.059887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.063120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3548e20-6057-4a61-97b5-997de1e6d5b5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.069778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 397/793] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/endpoints?service_id=4ec5c6d025e04a0487734943446dec4e&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:06.080153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.088457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc50332-ce38-49f1-b53f-bdf0d4f0363c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.100717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.100717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.100717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.100717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.101102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.101391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff2800-a90f-4361-894d-f2711b2b4818 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.108524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 397/794] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:06.134743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ca88-54dc-4ebb-ba64-f8c3f131310a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.135272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ca88-54dc-4ebb-ba64-f8c3f131310a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.135689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602ca88-54dc-4ebb-ba64-f8c3f131310a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.138020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 398/795] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:06.146030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.146609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.147040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.167162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:06.168866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:06.177924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 398/796] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:06 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:06.203684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602ca88-54dc-4ebb-ba64-f8c3f131310a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.219059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602ca88-54dc-4ebb-ba64-f8c3f131310a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.224014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.225051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.225476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.225889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.226747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.228516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.241676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 08:28:06.243606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 399/797] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:06.252109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.261978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d07c-c3e6-4ec7-80dc-daa33e56551d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.268514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.269492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.269958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.270379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.271294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:06.271796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.273618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f900d59-1556-4736-b84f-fac98ecfaad9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.279987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 399/798] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:06.286789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:06.297453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeffcc9-d68e-4ed1-9054-3a64acb44235 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:06.302619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:06.303361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:06.303658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:06.303946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:06.304763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:06.305124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:06.306917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaace94f-03da-4b49-912b-0f5d16118557 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:06.318694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 400/799] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:06 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:07.275110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50af0-241b-4c6f-b8ab-815f3a14eaec None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.275623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50af0-241b-4c6f-b8ab-815f3a14eaec None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.275742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50af0-241b-4c6f-b8ab-815f3a14eaec None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.277706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 400/800] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:07.284219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.284660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.284802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.304488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:07.305877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:07.315348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 401/801] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:07.339266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50af0-241b-4c6f-b8ab-815f3a14eaec None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.352431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50af0-241b-4c6f-b8ab-815f3a14eaec None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.356808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.358145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.358434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.358727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.369604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:07.377537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:07.379066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 401/802] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:07.385531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.394674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5eb90-cf9c-46ee-be05-745b575c6d8a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.399299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.399962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.400242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.400517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.401280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:07.401583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.403212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.412247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 402/803] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:07.418618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.429541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bd8f-b869-43a2-a827-dbd66d091621 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.434308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.435190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.436071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.436353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.447471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.449394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.468038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:07.469568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 402/804] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:07.476028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.487322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773330-c713-4329-a746-9de52cf60e8a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.492005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.492674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.492955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.493232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.493985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:07.494291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.495964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.508959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 403/805] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:07.515435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.525411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e9ae-fc32-4d73-9f4e-60fafa15fa59 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.531309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.532181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.532463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.532737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.540864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.543057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.559854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:28:07.561407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 403/806] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:07.567826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.578431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36dce9-41d6-4e1d-b2e6-b742889513d0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.583401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.584136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.584416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.584745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.585614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:07.586010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.587909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.612269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 404/807] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:07.618639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.628945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea47e4d-6b28-4854-9838-20a2b0f1575e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.633825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.634653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.634990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.635276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.646719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.648652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.667409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:07.674468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 404/808] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:07.675853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.686277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5b29c-b36f-414b-a375-02232cb613ca admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.690905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.691626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.691908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.692182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.692989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:07.693348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.694984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.712660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 405/809] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:07.714010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.725096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6a3-b35f-4a46-828d-04d04dd3978a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.729950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.730878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.731164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.731440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.740201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.742268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.756403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:07.757973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 405/810] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:07.764234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.780793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b697f-2279-464a-9b79-ca518b5b0b12 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.785750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.786513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.786790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.787067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.787921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:07.788230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.790244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988f246-804b-4e4f-ac66-b053251f335c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.803781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 406/811] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:07.810656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:07.821538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc3bc-ecae-472b-8c2f-9c95ed714094 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:07.826914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:07.828005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:07.828341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:07.828670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/bfa6e1051d6d4779acc95a619cc9ee39/roles/85366a8a1f4e4d4387dcd1b3798c8ae9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:07.831070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=bfa6e1051d6d4779acc95a619cc9ee39, role_id=85366a8a1f4e4d4387dcd1b3798c8ae9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:07.833948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d0a7a-a441-4475-acab-c4ee658f9715 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:07.851060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 406/812] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:07 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/bfa6e1051d6d4779acc95a619cc9ee39/roles/85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:28:08.140709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f5fc-a63e-46f4-a237-d60999497d73 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.140709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f5fc-a63e-46f4-a237-d60999497d73 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.140709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f5fc-a63e-46f4-a237-d60999497d73 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.141591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 407/813] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:08.149635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.149635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.149635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.168382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:08.170078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:08.229870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 407/814] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:08 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:08.255185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4f5fc-a63e-46f4-a237-d60999497d73 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.269069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4f5fc-a63e-46f4-a237-d60999497d73 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.273838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.274909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.275397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.275872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.276731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.278555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.290887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 08:28:08.293184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 408/815] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:08.301211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.313050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce7f50-a24a-4aae-beab-7659c094aa86 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.318320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.319613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.320155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.320623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.321568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:08.322092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.324042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.331663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 408/816] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:08.338303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.349530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e179f-0450-4195-bcc0-f37fa94087ee admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.354701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.355611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.356103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.356566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.358102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:08.358690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.360612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.366617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 409/817] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:08.374448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.384616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ef6ae-0894-4e8e-98b0-8d3a1a6edad0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.390813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.391812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.392301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.392762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.393796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] RBAC: Adding query filter params (interface=public, service_id=79f2c493dfcc4d05bf4dc13b516d71a2, region_id=RegionOne) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:08.394324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.395606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:08.395606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:28:08.395606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:28:08.396892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c93dc-008e-4235-9c38-429071947b56 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.405799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 409/818] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/endpoints?service_id=79f2c493dfcc4d05bf4dc13b516d71a2&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:08.412266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.423342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d690-1064-4fc4-a2ec-3f7c1a44c8d3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.428378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.429323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.429826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.430299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.431280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.433129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ab8d0-1c85-4a38-a57c-6a51da19d9b5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.440881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 410/819] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:08.461100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad855-5ab0-45d3-82db-d2cfae7e78c6 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.461518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad855-5ab0-45d3-82db-d2cfae7e78c6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.461756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad855-5ab0-45d3-82db-d2cfae7e78c6 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.464484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 410/820] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:08.472302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.472631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.472970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.493955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:08.495228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:08.504203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 411/821] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:08 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:08.529961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fad855-5ab0-45d3-82db-d2cfae7e78c6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.543185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fad855-5ab0-45d3-82db-d2cfae7e78c6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.548883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.549891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.550245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.550705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.551524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.553452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.567748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 08:28:08.569432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 411/822] 10.222.0.76 () {56 vars in 1153 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:08.578145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.588371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1260b-4739-456f-9e6e-fd7c8f07d2ec None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.594134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.594921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.595208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.595485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.596272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:08.596594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.598234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.604076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 412/823] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:08.611115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.624535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cd290-b2f2-4492-a784-729795364be6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.629705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.630432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.630753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.631035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.631829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:08.632138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.633891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d104f4-95bf-4d28-af06-a250bb8c8788 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.640472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 412/824] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:08 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:08.646902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.657596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8897-8e73-4002-a87a-93f1de296c8c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.662721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.663470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.663813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.664094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.664982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.666706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163d3ea-af47-4696-a5ec-71d170bd84b3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.690751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 413/825] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:08 2021] POST /identity/v3/endpoints => generated 347 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:08.725110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424a79-67a6-4240-8570-f025961a75cc None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.725582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424a79-67a6-4240-8570-f025961a75cc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.725948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff424a79-67a6-4240-8570-f025961a75cc None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.728435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 413/826] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:08.736100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a539-3678-48d4-92a7-3a08e8231a85 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.736778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a539-3678-48d4-92a7-3a08e8231a85 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.737155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a539-3678-48d4-92a7-3a08e8231a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.757370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c9c4a539-3678-48d4-92a7-3a08e8231a85 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:08.758824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c9c4a539-3678-48d4-92a7-3a08e8231a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:08.781470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 414/827] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:08 2021] POST /identity/v3/auth/tokens => generated 2003 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:08.805922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff424a79-67a6-4240-8570-f025961a75cc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:08.820440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff424a79-67a6-4240-8570-f025961a75cc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:08.826460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:08.827360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:08.827748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:08.828163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:08.829022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:08.830949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53c58-921a-4506-9ff3-a13879191330 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:08.850624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 414/828] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:08 2021] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:10.240971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd511d-7fcd-4b64-bedb-c3e2d5d4b555 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.241633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd511d-7fcd-4b64-bedb-c3e2d5d4b555 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.241633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd511d-7fcd-4b64-bedb-c3e2d5d4b555 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.243596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 415/829] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:10.250547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.251137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.251137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.269864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:10.271105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:10.295133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 415/830] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:10.315171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd511d-7fcd-4b64-bedb-c3e2d5d4b555 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.328254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd511d-7fcd-4b64-bedb-c3e2d5d4b555 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.332804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.333609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.333890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.334162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.345167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:10.352641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:10.358606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 416/831] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:10.361265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.371144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be051c8-bd28-4bb2-bcd9-30e0a4089419 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.376633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.377297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.377585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.377864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.378676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.378986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.380597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.394488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 416/832] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.395886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.407396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a1ca-cba1-46e6-b135-616036217279 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.412198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.412992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.413276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.413556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.425089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.427063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.445427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:10.446994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 417/833] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:10.453212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.463494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec731e28-b6c7-4ba2-904a-11f3a15a61c9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.469163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.469823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.470106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.470385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.471231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.471539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.473210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.490627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 417/834] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.493532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.503896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea22eed-bc9f-479a-b697-e5ee1b63060f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.508756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.509582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.509895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.510180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.517957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.520094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.535360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 08:28:10.541938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 418/835] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:10.543346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.554161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b6af-38af-4d05-90a4-6afc82403da5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.559152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.559876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.560160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.560471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.561395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.561707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.563721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.586641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 418/836] 10.222.0.76 () {56 vars in 1170 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.589371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.603826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c83ee-2ac0-4b65-a767-b5e5d8431278 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.609698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.610360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.610719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.611015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.620147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.621975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.636859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 419/837] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:10.638246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.648426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49b70d-5176-4353-b1f0-ea1de7f8072b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.653378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.654839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.655124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.655404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.666755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.668613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.687118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:10.693539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 419/838] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:10.695064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.704661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e5f8-e812-4780-9795-30b0138f36a5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.709647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.710328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.710658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.710939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.711743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.712051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.713721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.730651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 420/839] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.734072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.745532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c526a14-5065-4d61-8171-9af733c66104 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.749486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.750324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.750644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.750926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.758530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.760573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.774419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:10.781808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 420/840] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:10.783258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.793710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35caaa-1972-4e0b-84cd-239a0f74f7c0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.800259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.800942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.801276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.801557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.802392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.803739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.805390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaa006-193e-4459-9133-080dbd7cfe22 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.823387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 421/841] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.827490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:10.838804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abe679-394c-41e0-96e5-c9020fc01ffe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:10.844497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:10.845151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.845487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.845862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.846747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] RBAC: Adding query filter params (role.id=85366a8a1f4e4d4387dcd1b3798c8ae9, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=bfa6e1051d6d4779acc95a619cc9ee39) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:10.847058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:10.849029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b868a-aff2-4117-9cff-604f3485759f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:10.862774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 421/842] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:10 2021] GET /identity/v3/role_assignments?user.id=bfa6e1051d6d4779acc95a619cc9ee39&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:10.977061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f55e0-254d-4175-bf4c-bdbe292bd6af None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.977386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f55e0-254d-4175-bf4c-bdbe292bd6af None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.977618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f55e0-254d-4175-bf4c-bdbe292bd6af None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:10.979898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 422/843] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:10.989027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc67c-efd2-4f2f-9e6b-000b29c58f69 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:10.989027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc67c-efd2-4f2f-9e6b-000b29c58f69 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:10.989027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fc67c-efd2-4f2f-9e6b-000b29c58f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.007555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-094fc67c-efd2-4f2f-9e6b-000b29c58f69 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:11.009096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-094fc67c-efd2-4f2f-9e6b-000b29c58f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:11.019229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 422/844] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:11.046784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f55e0-254d-4175-bf4c-bdbe292bd6af None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.059480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9344f-664c-410f-86a4-9edf2eabd086 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.059819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9344f-664c-410f-86a4-9edf2eabd086 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.060066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9344f-664c-410f-86a4-9edf2eabd086 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.062532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 423/845] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:11.063510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f55e0-254d-4175-bf4c-bdbe292bd6af None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.068895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.069155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.069388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.069621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.070689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.071234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.071806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.072893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.075170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.088604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 08:28:11.092182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 423/846] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:11.097036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:11.098435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:11.099069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.106961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 424/847] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:11 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:11.110030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580aba3-1fd9-4164-bb9c-b4cc247f17d3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.115063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.115660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.115949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.116227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.116959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.117265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.119401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.126543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 424/848] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.131688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.131837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.142613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5685-7eb3-46f9-b77c-f7d2a30faf54 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.143199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073fd4-55fd-449e-861e-7a0c40ee09a4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.147411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.148201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.148480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.148749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.149415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.150782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.151314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.151932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.152422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.152908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.153853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.155091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.156977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.162809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 425/849] 10.222.0.76 () {56 vars in 1135 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.164111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 08:28:11.165448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 425/850] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:11.172088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.172235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.182483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4a56-294a-4c95-8a4f-7d6f78a5ebef admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.183654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68307-9213-4222-9b09-26d897818fc6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.189100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.189754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.190031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.190148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.190328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.190796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.191086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.191192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.191366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.192092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.192401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.192670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a645f-a34f-47e7-b25b-4612d0bb4f11 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.193991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d55b8-6115-4b6e-8187-abfe6180b21e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.199663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 426/851] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.212374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91568de-e4f8-4c3a-a033-b3e4160edb95 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.212766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91568de-e4f8-4c3a-a033-b3e4160edb95 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.213289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91568de-e4f8-4c3a-a033-b3e4160edb95 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.215582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 427/852] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:11.216855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91568de-e4f8-4c3a-a033-b3e4160edb95 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.219792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 426/853] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:11 2021] POST /identity/v3/endpoints => generated 346 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:11.228408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.228989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.229489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.241181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91568de-e4f8-4c3a-a033-b3e4160edb95 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.246418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.247289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.247640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.248571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.249638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.250053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.251852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.256786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:11.258370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 428/854] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.261023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:11.277855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 427/855] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:11 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:11.303715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.315848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce4438-5f52-4bc0-855a-71126a112a51 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.321461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.322852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.323349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.323805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.324781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.327563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.340629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 08:28:11.342458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 429/856] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:11.349794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.360208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b5d7-26a9-4aa7-9c54-022ce19ee192 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.365958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.367037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.367501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.367965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.368899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.369401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.371315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.378014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 428/857] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.385064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.396662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c3269-8219-4b39-8acd-bf3db00c7803 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.402026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.403261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.403728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.404325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.405270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.405788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.407637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.413674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 430/858] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.421119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.432084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f339639-7061-4438-a887-b8fe9d9e6801 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.438272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.439330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.439809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.440260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.441266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] RBAC: Adding query filter params (interface=public, service_id=436e1d94e68c445c8367fafa6f7569e5, region_id=RegionOne) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:11.441788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.443658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22649da-4b39-49c6-9bb9-bab27b5a5879 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.450193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 429/859] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/endpoints?service_id=436e1d94e68c445c8367fafa6f7569e5&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:11.457509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:11.470159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e0386-fc88-4bb3-bbb8-f3dc39d43400 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:11.476624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:11.477597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:11.478057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:11.478539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:11.479434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:11.481286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656366e-0715-4485-a3fb-74e818e5896d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:11.488710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 431/860] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:11 2021] GET /identity/v3/services => generated 1497 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:13.328072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21efc-d257-4a3a-b442-54fad7b3a36b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.328590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21efc-d257-4a3a-b442-54fad7b3a36b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.328704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21efc-d257-4a3a-b442-54fad7b3a36b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.330702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 430/861] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:13.336860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.337660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.338086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.356418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:13.358381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:13.370594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 432/862] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:13.391174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21efc-d257-4a3a-b442-54fad7b3a36b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.403889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21efc-d257-4a3a-b442-54fad7b3a36b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.408908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.409880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.410310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.410748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] PATH_INFO: `/v3/services/image` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.411578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.413327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.425195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 08:28:13.430624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 431/863] 10.222.0.76 () {56 vars in 1126 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:13.434204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.449081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01710d-0ced-4a20-9027-8d641025dd00 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.454378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.455427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.455875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.456307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.457286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] RBAC: Adding query filter params (name=image) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:13.457753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.459748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafe18d-748b-4945-8fbf-3f94efdedcaf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.470654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 433/864] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:13.473562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.484791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516fd5-d0eb-4667-93f0-4a1486f40dab admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.490251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.491208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.491656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.492076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.492975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] RBAC: Adding query filter params (type=image) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:13.493428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.495228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba755-b4df-472b-9365-8e525653c7ab admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.506644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 432/865] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services?type=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:13.593992 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6906-3220-4535-8166-c50e3bacfb0f None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.594316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6906-3220-4535-8166-c50e3bacfb0f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.594572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe6906-3220-4535-8166-c50e3bacfb0f None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.596716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 434/866] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:13.603281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.603573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.603848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.615490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8c3-93b4-48c6-a8e3-b5358d134e7a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.615768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8c3-93b4-48c6-a8e3-b5358d134e7a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.615966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a8c3-93b4-48c6-a8e3-b5358d134e7a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.618048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 435/867] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:13.624432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.624764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.625001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.625416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:13.626744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:13.642533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 433/868] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:13.650851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:13.652070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:13.661059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 436/869] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:13.661759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.672017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d5d5c-486d-4563-9db2-b3bc5f61fae9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.676988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.677696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.677979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.678253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.679063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.680769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.691571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.698236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 434/870] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:13.702563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d641ae-db33-48e3-a455-36068ae109fc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.724780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.725828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.726287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.726738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.727692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.729865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.731589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.common [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 08:28:13.751945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.sql.core [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 08:28:13.751945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 08:28:13.751945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [parameters: {'id': '3a1e0cda371a4291b222176d85198dde', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 08:28:13.751945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79640) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 08:28:13.767480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5fc6cfbf-0635-4019-a639-3a09a777b725 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a1e0cda371a4291b222176d85198dde.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3a1e0cda371a4291b222176d85198dde. Oct 28 08:28:13.769276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 437/871] 10.222.0.76 () {60 vars in 1161 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/projects => generated 262 bytes in 78 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:13.775802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.791034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556017f9-b326-4b4b-ace3-cbac9872d969 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.797620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.798807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.799268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.799730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.808016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.811240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.829585 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:13.832069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 435/872] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:13.839301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd669e4-4b73-4a50-ad63-10cb046e1900 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.840066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd669e4-4b73-4a50-ad63-10cb046e1900 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.840576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd669e4-4b73-4a50-ad63-10cb046e1900 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.840773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.847040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 438/873] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:13 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:13.854232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.854583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.854826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.855286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd234d-522b-455a-b08d-95321bf08d31 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.860814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.862126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.862651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.863134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.864152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:13.864691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.867055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.875372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:13.876978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:13.886094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 439/874] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:13 2021] POST /identity/v3/auth/tokens => generated 2387 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:13.889493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 436/875] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:13.913798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.924592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536163f7-0714-4d95-8b0c-1f540af28b68 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.930041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.931447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.932017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.932511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.933448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.935825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.952155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 08:28:13.954243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 440/876] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:13.961575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:13.973272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae120c-8ded-49b2-aee3-6329ff7e49d9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:13.978786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:13.979860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:13.980400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:13.980883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:13.981838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:13.982447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:13.984443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:13.991939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 437/877] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:13.998971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:14.009905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6235fa6-60da-41eb-b47d-85172c3fa5af admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:14.016063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:14.017153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:14.017688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:14.018165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:14.019256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:14.019788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:14.021821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318d04a-5733-4633-821b-ebdd3bf7359f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:14.028496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 441/878] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:13 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:14.035981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:14.047193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e144f2-c270-4e50-b8ac-cd9aa748b520 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:14.052968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:14.054101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:14.054629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:14.055152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:14.056211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:14.058126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9c937-9274-4a4b-b33b-c79351be3b0c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:14.081496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 438/879] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:14 2021] POST /identity/v3/endpoints => generated 349 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:15.865058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84a29-7941-4c50-ab28-a16fe0ded37b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:15.865607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84a29-7941-4c50-ab28-a16fe0ded37b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:15.865607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf84a29-7941-4c50-ab28-a16fe0ded37b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:15.867726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 442/880] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:15.876966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a39c3-3ff4-408f-8b49-eb5dd2e160dd None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:15.877471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a39c3-3ff4-408f-8b49-eb5dd2e160dd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:15.877684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a39c3-3ff4-408f-8b49-eb5dd2e160dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:15.896564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6b8a39c3-3ff4-408f-8b49-eb5dd2e160dd None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:15.897796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6b8a39c3-3ff4-408f-8b49-eb5dd2e160dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:15.922615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 439/881] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:15 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:15.942182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf84a29-7941-4c50-ab28-a16fe0ded37b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:15.955632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf84a29-7941-4c50-ab28-a16fe0ded37b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:15.960223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:15.960877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:15.961164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:15.961473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:15.962226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:15.963877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abfba4-2a27-4625-837e-fca0cf4ab7bd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:15.979843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 443/882] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:15 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:16.062860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42943-ce8d-4c97-9c50-26f87137bddb None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.063203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42943-ce8d-4c97-9c50-26f87137bddb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.063426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e42943-ce8d-4c97-9c50-26f87137bddb None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.065317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 440/883] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:16.072339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.072794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.073176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.101085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:16.102334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:16.130808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 444/884] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:16.149723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42943-ce8d-4c97-9c50-26f87137bddb None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.163366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e42943-ce8d-4c97-9c50-26f87137bddb None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.168426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.170316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.171071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.171575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.172475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.174332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.187223 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 08:28:16.188865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 441/885] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:16.196024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.205551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8823b-0a93-4d3b-b9e8-110431002d04 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.211808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.212494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.212768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.213049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.213786 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.214086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.215776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.222151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 445/886] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.228783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.241274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255f842-42a5-4527-b0c9-cf48e112dfa3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.246056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.246818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.247106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.247389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.248702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.248991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.250642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacdf82-d10c-4697-8469-84df212ffb2d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.256540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 442/887] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.264288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.271934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b188-aa1c-4357-86dc-da1193e78020 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.272523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b188-aa1c-4357-86dc-da1193e78020 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.273320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b188-aa1c-4357-86dc-da1193e78020 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.275236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642535f-6e31-444c-8592-22cb2d498e88 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.275945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 443/888] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:16.281942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.282231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.282533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.283397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.284275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.284778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.285255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.286277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] RBAC: Adding query filter params (interface=public, service_id=9f6d6a1febdc40e68110e075d223cbb8, region_id=RegionOne) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.286813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.288613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.298707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 446/889] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/endpoints?service_id=9f6d6a1febdc40e68110e075d223cbb8&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.301675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:16.303073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:16.304832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.314342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 444/890] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:16.318609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef5441-a123-42fb-acb8-990c6739a8b3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.321514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.322279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.322678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.323029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.323830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.325571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.338666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 447/891] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:16.345543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.355759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36564b-8757-4c15-a3bc-cfbae033082d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.361597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.362630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.363126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.363588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.364501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.366642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.368255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.common [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 08:28:16.383014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.sql.core [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 08:28:16.383014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 08:28:16.383014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [parameters: {'user_id': '866b37225a5a4f54bcd3dc1407999444', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 08:28:16.383014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79639) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 08:28:16.390346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 08:28:16.392364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 445/892] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:28:16 2021] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:16.399350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.411151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac50a9-8c62-4674-a7b0-d9f74de6717a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.416370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.417498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.417933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.418595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.428087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.430527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.446998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5e378b65-daa3-4377-b673-b64c464dc7d2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 08:28:16.448816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 448/893] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:16.456400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.468138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0cbd8-9b55-4b2f-927b-befa3a5533b9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.472491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf339b-3ea9-47e3-9ff8-f685981c32d3 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.472777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf339b-3ea9-47e3-9ff8-f685981c32d3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.473058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf339b-3ea9-47e3-9ff8-f685981c32d3 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.475085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.475231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 449/894] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:16.476104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.476598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.477013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.478092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.478586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.481178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.481574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.481892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.482181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.502950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:16.504176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:16.518667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 450/895] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:16.528495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 446/896] 10.222.0.76 () {56 vars in 1122 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.538721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.549061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34302-63d8-4ee0-9c2f-75ba517be59a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.554101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.555027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.555307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.555577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.556322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.558061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.572181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 08:28:16.573780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 451/897] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:16.581449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.592313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6805f-15fa-42b4-9e7d-333c6a2dea0f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.597583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.598282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.598594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.598933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.599684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.599994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.601740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.608516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 447/898] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:16.615371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.626774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e170-9386-4378-9053-e785dd4b1c2c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.631840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.632520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.632807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.633142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.633834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.634144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.635840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.648418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 452/899] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.649809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.660306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e639dac-f94c-4256-b06a-f72ff926673a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.665134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.665813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.666099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.666376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.667330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] RBAC: Adding query filter params (interface=admin, service_id=436e1d94e68c445c8367fafa6f7569e5, region_id=RegionOne) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:16.667654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.669295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534499-faf3-44d2-8b50-f0284251b4ed admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.681033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 448/900] 10.222.0.76 () {56 vars in 1270 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/endpoints?service_id=436e1d94e68c445c8367fafa6f7569e5&interface=admin®ion_id=RegionOne => generated 193 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:16.682478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:16.693298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685c7e8-09f9-408a-ac73-7bc654472362 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:16.698174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:16.698983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:16.699276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:16.699560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:16.700280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:16.702592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba38d99-5abf-4edc-9901-ef9d49445241 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:16.714669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 453/901] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:16 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:18.371194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabacd-54db-494d-8072-56a766161bfa None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.371710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabacd-54db-494d-8072-56a766161bfa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.371710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcabacd-54db-494d-8072-56a766161bfa None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.373651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 449/902] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:18.379703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.380126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.380313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.398625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:18.399835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:18.408444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 454/903] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:18 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:18.432419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcabacd-54db-494d-8072-56a766161bfa None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.444878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcabacd-54db-494d-8072-56a766161bfa None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.449220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.450014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.450295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.451177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.451819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.453432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.464580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 08:28:18.465907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 450/904] 10.222.0.76 () {56 vars in 1126 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:18.472379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.481569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d6a4d-8668-48d9-b86c-88ebb5080a89 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.487138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.487884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.488239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.488581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.489376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:18.489806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.491448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.496532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 455/905] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:18.503538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.513627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c84b5-c2e8-4222-859f-7d6adc6d8d9b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.518511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.519220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.519508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.519788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.520546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:18.520901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.522525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.534308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 451/906] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services?type=image => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:18.535570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.546559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108135f-a483-4e88-83d7-03dc3dd517c4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.551905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.552568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.552847 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.553121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.553931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] RBAC: Adding query filter params (interface=public, service_id=9fe1ff5751ef4a5eb009ed985d3691ed, region_id=RegionOne) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:18.554238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.555892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f7572-58a3-4cee-af2e-d944c1490ab5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.563338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 456/907] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/endpoints?service_id=9fe1ff5751ef4a5eb009ed985d3691ed&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:18.569536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.579920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd6954-899d-4750-a22c-3446e23415dd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.584737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.585175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.585460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.585734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.586430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.588061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e813116-740e-4639-8e15-3c47d6c618b7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.598699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 452/908] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:28:18.670817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7843-fab7-42db-b86f-bb90b2850093 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.671073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7843-fab7-42db-b86f-bb90b2850093 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.671400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d7843-fab7-42db-b86f-bb90b2850093 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.673327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 457/909] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:18.679945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.680276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.680509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.700479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:18.702333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:18.710678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 453/910] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:18 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:18.735824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7843-fab7-42db-b86f-bb90b2850093 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.749790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d7843-fab7-42db-b86f-bb90b2850093 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.754650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.755461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.755739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.756010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.756685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.758305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.770711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 08:28:18.774525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 458/911] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:18.780083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.789685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f6882-3560-4ab3-9235-ca5304e55a6b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.794976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.795945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.796289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.796657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.797477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:18.797850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.799600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.805260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 454/912] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:18.811562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.822414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d55f8-ba1b-438f-9cdd-02baca1e1629 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.827693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.828381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.828667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.828943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.829680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:18.829988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.831658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50b9c-6e07-437c-a251-8f45a5444077 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.838029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 459/913] 10.222.0.76 () {56 vars in 1133 bytes} [Thu Oct 28 08:28:18 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:18.844780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:18.856040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e92a4-d053-48cd-8a31-0cb106438c97 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:18.862119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:18.862828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:18.863114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:18.863386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:18.864158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:18.865769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15eb8-a7e7-47ec-a30c-b982da8aa2ed admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:18.888796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 455/914] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:18 2021] POST /identity/v3/endpoints => generated 334 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:19.030326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd61a-3b8e-47e1-a96b-fbb0041a7d5a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.030601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd61a-3b8e-47e1-a96b-fbb0041a7d5a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.030850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cd61a-3b8e-47e1-a96b-fbb0041a7d5a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.032712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 460/915] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:19.039673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.039969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.040237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.060527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:19.061638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:19.083572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 456/916] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:19 2021] POST /identity/v3/auth/tokens => generated 2828 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:19.109609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd61a-3b8e-47e1-a96b-fbb0041a7d5a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:19.122183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cd61a-3b8e-47e1-a96b-fbb0041a7d5a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:19.126963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:19.127754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.128035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.128311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.128981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:19.130622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:19.143203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 08:28:19.144981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 461/917] 10.222.0.76 () {56 vars in 1147 bytes} [Thu Oct 28 08:28:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:19.151760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:19.162646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557e46c-069f-4157-b4d0-58bf021ee84c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:19.167351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:19.168016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.168300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.168575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.169314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:19.169609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:19.171390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:19.176810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 457/918] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:19.183126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:19.194716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c76ab-247f-45a9-a998-dc457644380d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:19.199453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:19.200100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.200385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.201190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.201921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:19.202231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:19.203860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69aef1e-49db-435b-a672-e5c8f596acae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:19.210212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 462/919] 10.222.0.76 () {56 vars in 1143 bytes} [Thu Oct 28 08:28:19 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:19.215807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:19.227523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4e972-d083-43de-94bc-10495e5b3ae9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:19.232425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:19.233093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:19.233381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:19.233662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:19.234442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:19.236057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab11973-73a6-44b1-bc4c-6875cfb9272a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:19.252882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 458/920] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:19 2021] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:20.944651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc5-efea-470e-8a7e-f278938855a3 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:20.945156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc5-efea-470e-8a7e-f278938855a3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:20.945231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc5-efea-470e-8a7e-f278938855a3 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:20.947145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 463/921] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:20.953287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:20.953761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:20.953838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:20.972258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:20.973472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:20.994064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 459/922] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:20 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:21.018526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da2bc5-efea-470e-8a7e-f278938855a3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.031667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da2bc5-efea-470e-8a7e-f278938855a3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.036216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.036991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.037276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.037551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] PATH_INFO: `/v3/services/image` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.038228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.039864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.051407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 08:28:21.057917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 464/923] 10.222.0.76 () {56 vars in 1126 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:21.059164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.068652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60e370-6755-4912-95b0-dae423d83e9f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.073244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.073908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.074201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.074481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.075244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.075677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.083149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.088999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 460/924] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:21.096496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.106468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828704bb-082f-4c7b-89fb-0358239cadfa admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.111556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.112306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.112657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.113032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.113797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.114167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.115873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafee607-5d06-4e58-b9cf-189e29011913 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.121221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 465/925] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:21.128217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.137977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411b45a-8419-4777-ba69-6c0114319af9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.143608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.144275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.144560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.144954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.145613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.147315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc8ed-c633-478b-967e-37be684ea098 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.171679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 461/926] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:28:21 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:21.309373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d038f2-4a21-417a-b87a-6823f647c566 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.309713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d038f2-4a21-417a-b87a-6823f647c566 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.310514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d038f2-4a21-417a-b87a-6823f647c566 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.312701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 466/927] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:21.319228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.319590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.319954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.339900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:21.341394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:21.360989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 462/928] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:21.386887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d038f2-4a21-417a-b87a-6823f647c566 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.401413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d038f2-4a21-417a-b87a-6823f647c566 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.406733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.407543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.407825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.408097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.425290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:21.432789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:21.434262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 467/929] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:21.442724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.452649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640258d1-92b4-40e3-b456-f84cc521765b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.457912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.458757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.459113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.459464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.460337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.460708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.462453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.473247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 463/930] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:21.479625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.490366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ac66-8721-45a9-8e5a-39fdd54d4003 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.495091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.495872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.496159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.496443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.511745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.513637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.531339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:21.532770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 468/931] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:21.538955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.549328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f519fc-8780-4d96-9d90-909fd5cf39b0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.554075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.554771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.555061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.555339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.556087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.556392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.557981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b95124-721b-4468-a401-1bea188e59be admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.572669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 464/932] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:21.578594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.588594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03ee89-e128-4e68-b133-e302f8793d66 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.598289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51244-cb5b-4253-9a40-a858ba6e8a0a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.598289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51244-cb5b-4253-9a40-a858ba6e8a0a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.598289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51244-cb5b-4253-9a40-a858ba6e8a0a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.598289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 465/933] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:21.600530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.601345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.601603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.601879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.604446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.604723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.604991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.612393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.614460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.630926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:28:21.631212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:21.632315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 469/934] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:21.632422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:21.638656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.642536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 466/935] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:28:21.648407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868313-f284-4bae-813a-1f792f0959d9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.653045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.653826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.654117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.654397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.655286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.655594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.657434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.667552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.676243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 470/936] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:21.678805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb9251-0187-40e8-b208-c7fff3f21b7f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.682478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.683564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.684348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.684630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.685512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.687391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.689103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.695990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 467/937] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:21.696138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dde2d-8b91-4436-91a1-314dac1c2699 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.697286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.701181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.701622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.701916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.702189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.707081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2c724-bd25-4418-8857-2a52406ba0cf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.710218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.711644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.712029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.712282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.712568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.712844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.713558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.715663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.722270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 471/938] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:28:21.728403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.738120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13415d-9191-4f04-8090-ce38260f7433 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.742874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.743644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.743931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.744207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.746474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 468/939] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:21 2021] POST /identity/v3/projects => generated 311 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:28:21.754978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.756916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.775592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:21.777102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 472/940] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:21.784082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.849991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a75bc-6733-4305-bc76-f641e7f861a4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.854729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.855359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.855639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.855909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.856672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.857517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.859858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.872549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 469/941] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:21.879389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.890769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3955f-9b35-4789-811d-64ae023f157e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.895727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.896637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.896978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.897324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.905875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.908052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.922801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:21.924246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 473/942] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:21.930932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.941496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53e5d-c1a6-4503-bea4-ab80fb3eefa4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.946269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.946980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.947262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.947533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.948347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.948650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.951225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bfb27-85dc-494d-b4b2-6e779ff330d9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.970589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 470/943] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:21.971546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:21.982363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336872b4-beb3-4ebb-9824-354256c06af6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:21.988384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:21.989031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:21.989307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:21.989577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:21.990419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] RBAC: Adding query filter params (role.id=85366a8a1f4e4d4387dcd1b3798c8ae9, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:21.990758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:21.992600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bbd55-3a8f-400b-80b1-c96dbf039ff8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:21.999101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 474/944] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:21 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:23.514761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50940d-82f4-45bd-9897-780dff4ce035 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:23.515253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50940d-82f4-45bd-9897-780dff4ce035 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:23.515253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50940d-82f4-45bd-9897-780dff4ce035 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:23.517197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 471/945] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:23.522973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:23.523386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:23.523576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:23.540820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:23.542029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:23.550302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 475/946] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:23.575112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50940d-82f4-45bd-9897-780dff4ce035 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:23.589710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50940d-82f4-45bd-9897-780dff4ce035 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:23.595214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:23.595362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:23.595584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:23.595860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:23.604305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:23.606187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85cd6b-e280-4b58-9589-aed848724502 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:23.616798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 472/947] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:28:23.624612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:23.633679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88649a-b7ea-40c9-836a-3dce17cdb091 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:23.638258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:23.639042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:23.639296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:23.639573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:23.640785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:23.642527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557f58-8edb-4a37-8283-27a968b71475 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:23.644312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 476/948] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.118260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b21a2-6760-4502-acc3-10e071e808cc None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.118582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b21a2-6760-4502-acc3-10e071e808cc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.118869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b21a2-6760-4502-acc3-10e071e808cc None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.120664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 473/949] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:24.127462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.127755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.128039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.147568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:24.148818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:24.157602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 477/950] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:24.183524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b21a2-6760-4502-acc3-10e071e808cc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.196537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b21a2-6760-4502-acc3-10e071e808cc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.201453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.202231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.202537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.202816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.204000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.205714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395f9d8-86fd-4296-a829-76410fa53a49 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.207350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 474/951] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.213872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.223326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53cca-1e20-45fd-9153-ba2e472e8bb1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.227955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.228621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.228908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.229186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.229921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.231961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d19e2-48cc-46ed-b486-a4b91b82a6a8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.253690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 478/952] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:28:24 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:24.287679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccf79-fb47-427e-8b9c-bbe4111d9e33 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.287964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccf79-fb47-427e-8b9c-bbe4111d9e33 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.288247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ccf79-fb47-427e-8b9c-bbe4111d9e33 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.290089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 475/953] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:24.296975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.297261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.297541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.318160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:24.319448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:24.328027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 479/954] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:24.352476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccf79-fb47-427e-8b9c-bbe4111d9e33 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.366239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ccf79-fb47-427e-8b9c-bbe4111d9e33 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.370924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.371756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.372039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.372950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.384907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:24.392851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:24.394109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 476/955] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:24.401069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.410473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd4985-ae6d-4eba-894b-75cd580f743e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.415122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.415797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.416077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.416346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.417133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:24.417436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.419585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.428476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 480/956] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.435557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.446066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a03891-4349-4300-a262-ea626f640d14 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.450767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.451749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.452029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.452305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.463873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.465710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.484529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:24.485761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 477/957] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:24.492503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.503223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c69c2e-e905-45c1-af31-4474686070f4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.507861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.508512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.508801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.509080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.509827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:24.510136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.511800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.524843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 481/958] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.531562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.541371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ca034-632a-4c01-aae6-d26ffc842ace admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.546911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.547696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.547982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.548257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.555579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.557618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.572211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:28:24.573388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 478/959] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:24.580034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.589632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28372310-683a-4db1-8524-4f3555706b66 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.594449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.595135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.595416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.595690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.596590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:24.596880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.598749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.616758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 482/960] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.623765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.634666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09bdf-46d9-4e35-bc2e-8408da505467 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.639305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.640090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.640373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.640649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.651104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.652964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.670602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:24.671795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 479/961] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:24.678068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.688388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869a9c2-d77d-48bf-abe4-0f633ff531d1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.693000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.693648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.693935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.694216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.695003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:24.695311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.696922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.708718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 483/962] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.715205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.725402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd058514-2718-4cfe-9f60-6552a0f7817d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.729979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.730797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.731084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.731360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.739120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.741106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.753999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:24.755182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 480/963] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:24.762560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.773240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaffb08-e9b3-4709-99a6-95fcc9c6ecf5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.777829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.779002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.779334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.779616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.780418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:24.780726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.782608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618e878-2651-4c12-aba8-b82399b767b2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.795237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 484/964] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:24.801949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:24.812510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7558-30ef-4d28-aa37-48c0503fb1a8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:24.817058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:24.817918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:24.818200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:24.818472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/85366a8a1f4e4d4387dcd1b3798c8ae9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:24.820786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=1a17f0cdeb07409f8439829dc145d5fc, role_id=85366a8a1f4e4d4387dcd1b3798c8ae9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:24.823487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6d2e-7f13-446b-97b5-c57f29dcee1d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:24.836823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 481/965] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:24 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/1a17f0cdeb07409f8439829dc145d5fc/roles/85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:28:26.623696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d12c6-0cd8-4b28-b75c-d62f41ce5e8e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.624256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d12c6-0cd8-4b28-b75c-d62f41ce5e8e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.624256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d12c6-0cd8-4b28-b75c-d62f41ce5e8e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.626080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 485/966] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:26.632305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.632760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.632964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.654819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:26.660590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:26.721809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 482/967] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:26.746781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d12c6-0cd8-4b28-b75c-d62f41ce5e8e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.759658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d12c6-0cd8-4b28-b75c-d62f41ce5e8e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.764707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.765490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.765777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.766051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.776255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:26.783740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:26.784940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 486/968] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:26.791581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.801680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a774f-670c-4e9c-b85d-15d9eeb0a2e2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.806349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.807037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.807335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.807590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.808354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:26.808650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:26.811386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:26.819685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 483/969] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:26.827247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.837363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002ee9-6efa-4fbf-ab79-27e80c047db7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.842021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.842906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.843188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.843451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] PATH_INFO: `/v3/users/153fa98f101d4f80852daf5bfd420c84` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.856165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=153fa98f101d4f80852daf5bfd420c84)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:26.859945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:26.861882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 487/970] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/users/153fa98f101d4f80852daf5bfd420c84 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:26.868704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.879171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3182e-3810-4c6c-9548-8b2c2778d6f0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.883831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.884522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.884767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.885046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.893090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:26.894897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:26.904155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 484/971] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:26.910578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.920937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62f0d-cb42-4d04-a6c6-583048a221a4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.925564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.926442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.926749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.927022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.928306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:26.930446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c3c54-68d9-409b-9923-fed37c970b26 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:26.932858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 488/972] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:26.940419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:26.949880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dacdc-ef46-44e9-9afd-8d6eae7fe3fb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:26.955453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:26.956136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:26.956423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:26.956701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:26.957569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=233a02c8450f4e4594eb66d8b3cf1517, user.id=153fa98f101d4f80852daf5bfd420c84) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:26.957883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:26.959822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6cdf5-dc75-4b6d-b3b6-c93d42ac50ad admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:26.974575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 485/973] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:26 2021] GET /identity/v3/role_assignments?user.id=153fa98f101d4f80852daf5bfd420c84&scope.project.id=233a02c8450f4e4594eb66d8b3cf1517&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.081468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6720-1625-41b9-90e2-5ca292015617 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.081754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6720-1625-41b9-90e2-5ca292015617 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.082034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b6720-1625-41b9-90e2-5ca292015617 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.083888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 489/974] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:27.090660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.091450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.091789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.112608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:27.113869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:27.122097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 486/975] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:27.147310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6720-1625-41b9-90e2-5ca292015617 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.160735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b6720-1625-41b9-90e2-5ca292015617 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.165267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.166071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.166350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.166660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.178677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:27.186330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 08:28:27.187646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 490/976] 10.222.0.76 () {56 vars in 1141 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:27.194250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.203340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ca03-7f81-44e4-84fb-3b9a97dd5e97 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.208403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.209065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.209352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.209629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.210391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.210730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.212348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.226519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 487/977] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.227976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.239404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afcb3b-63f1-4382-8219-3e5b5b622ee7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.243997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.244768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.245049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.245322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.256229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.258062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.274798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:27.276015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 491/978] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:27.282970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.292617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d61b2-70c8-4d4a-9676-ede04d3cb086 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.297893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.298581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.298870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.299149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.299892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.300201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.301791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.318753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 488/979] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.320081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.330286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b7403-55a8-446b-9664-10ac63fc086d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.334936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.335714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.335997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.336268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.344520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.346673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.360351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 08:28:27.361909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 492/980] 10.222.0.76 () {56 vars in 1114 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:27.368048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.377657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51f066-e4f7-4ed1-a5b8-63ac0906364b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.382177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.382932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.383297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.383633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.384559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.384916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.386830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.404899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 489/981] 10.222.0.76 () {56 vars in 1154 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.411154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.421119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c20a-abef-4e64-b5d0-240f7f21591b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.425681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.426335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.426646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.426920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.435046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.436792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.445609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 493/982] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:27.452382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.461981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e11b-6300-4164-9cae-8ba55469ff2d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.467226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.468097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.468453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.468794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.479130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.480982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.498477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:28:27.499712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 490/983] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:27.506163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.516171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e7c8c-968a-46a8-9c27-ba374f27f938 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.520783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.521425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.521710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.521987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.522746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.523054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.524647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.536331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 494/984] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.542351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.552048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97119d2-bacf-4034-8316-8e0800b74145 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.556614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.557395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.557680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.557957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.564941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.566938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.580371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:28:27.581628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 491/985] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:28:27.588464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.601518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e54d2-42a9-49ae-b6bf-59d1c1d4f712 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.606313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.607270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.607503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.607745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.608558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.608943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.610751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27c0d5-c7a2-4aea-b483-72ca441943c1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.623158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 495/986] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:27.629834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:27.641264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf196-cda1-4e7c-8349-bc2436caa209 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:27.645996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:27.646688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:27.646977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:27.647256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:27.648108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] RBAC: Adding query filter params (role.id=85366a8a1f4e4d4387dcd1b3798c8ae9, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=1a17f0cdeb07409f8439829dc145d5fc) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:27.648420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:27.650264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d776c43-e10a-4fb1-9453-ca0307eecde7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:27.657266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 492/987] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:27 2021] GET /identity/v3/role_assignments?user.id=1a17f0cdeb07409f8439829dc145d5fc&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=85366a8a1f4e4d4387dcd1b3798c8ae9 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:29.214588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa890-e6cd-4cfc-8bb4-08e0c7302d1a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.215112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa890-e6cd-4cfc-8bb4-08e0c7302d1a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.215439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa890-e6cd-4cfc-8bb4-08e0c7302d1a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.218146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 496/988] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:29.224304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.224729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.224857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.242663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:29.243862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:29.251869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 493/989] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:29.275285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa890-e6cd-4cfc-8bb4-08e0c7302d1a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:29.288031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa890-e6cd-4cfc-8bb4-08e0c7302d1a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:29.292412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:29.293181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.293467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.293742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.304486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:29.311488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:29.312633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 497/990] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:29.319255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:29.328140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1eb66-a4f0-4222-aa05-a420d2cdce7a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:29.332732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:29.333450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.333734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.334009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.334825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:29.335136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:29.336732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:29.345519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 494/991] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:29.351785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:29.362753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476311-a192-4ea2-b8e7-61e331d3a487 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:29.367267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:29.368107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.368387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.368660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] PATH_INFO: `/v3/users/153fa98f101d4f80852daf5bfd420c84` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.369857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=153fa98f101d4f80852daf5bfd420c84)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:29.372076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:29.373857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 498/992] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:29 2021] GET /identity/v3/users/153fa98f101d4f80852daf5bfd420c84 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:29.380003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:29.389518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a0b7-eb11-4389-9b88-e846d603b3bc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:29.394163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:29.395048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.395335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.395614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.396810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:29.398912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa23e-a8c8-4b25-aae5-5aeb4c08e86d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:29.400544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 495/993] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:29 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:29.407514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:29.416926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4236-c214-41d3-92b0-09d6cf1203f0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:29.422123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:29.423010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:29.423291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:29.423568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517/users/153fa98f101d4f80852daf5bfd420c84/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:29.425511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233a02c8450f4e4594eb66d8b3cf1517, user_id=153fa98f101d4f80852daf5bfd420c84, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:29.428237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db514476-b374-4e8e-a4d6-f76bf1ce6ad4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:29.440948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 499/994] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:29 2021] PUT /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517/users/153fa98f101d4f80852daf5bfd420c84/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:28:31.689867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeee-6ba0-4b87-a3c4-25ea73371f24 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.690404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeee-6ba0-4b87-a3c4-25ea73371f24 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.690404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeee-6ba0-4b87-a3c4-25ea73371f24 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.692237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 496/995] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:31.698211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.698602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.698817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.717370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:31.718582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:31.773921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 500/996] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:31.798793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acceeee-6ba0-4b87-a3c4-25ea73371f24 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.811563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acceeee-6ba0-4b87-a3c4-25ea73371f24 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.815984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.816864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.817159 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.817439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.828935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:31.835878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:31.837040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 497/997] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:31.843773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.852605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbd3ab-f0b2-4271-8ee9-8e002f6d53ca None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.857637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.858284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.858602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.858882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.859646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:31.859951 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:31.861793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:31.869884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 501/998] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:31.877559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.887156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd498f-e975-4f56-a565-578ca12dd2fb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.891942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.892794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.893075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.893347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] PATH_INFO: `/v3/users/153fa98f101d4f80852daf5bfd420c84` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.894587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] RBAC: Authorizing `identity:get_user(user_id=153fa98f101d4f80852daf5bfd420c84)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:31.896705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:31.898276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 498/999] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/users/153fa98f101d4f80852daf5bfd420c84 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:31.904588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.915455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff23df-5f7c-4f62-bf76-e608669a5d18 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.920551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.921189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.921473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.921751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.929678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:31.931473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:31.941046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 502/1000] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:31.947666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.957441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e44df-e8a0-4fce-9bd7-20e8e8658440 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.962006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.962884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.963170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.963447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.964650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:31.966851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194e854-e818-4586-ac3f-c5991cb21a82 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:31.968502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 499/1001] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:31.975031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:31.984352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094f65a-a996-4274-aba8-97fb08361f94 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:31.989179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:31.989807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:31.990092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:31.990367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:31.991268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=233a02c8450f4e4594eb66d8b3cf1517, user.id=153fa98f101d4f80852daf5bfd420c84) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:31.991576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:31.993409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b9a2d-f081-43ac-86a8-66cf27ab7c44 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:31.999763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 503/1002] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:31 2021] GET /identity/v3/role_assignments?user.id=153fa98f101d4f80852daf5bfd420c84&scope.project.id=233a02c8450f4e4594eb66d8b3cf1517&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:34.263701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8620-2c62-4ff2-bd48-a4877f804a6a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:34.264651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8620-2c62-4ff2-bd48-a4877f804a6a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:34.264651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf8620-2c62-4ff2-bd48-a4877f804a6a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:34.266326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 500/1003] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:34.276344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:34.277638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:34.277638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:34.297768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:34.299012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:34.306796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 504/1004] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:34.333258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf8620-2c62-4ff2-bd48-a4877f804a6a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:34.346140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf8620-2c62-4ff2-bd48-a4877f804a6a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:34.350477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:34.351314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:34.351594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:34.351903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:34.353234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:34.354966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22072600-aaf6-4bb5-b280-ea629156b0bb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:34.356872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 501/1005] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:34.363099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:34.372018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e450cdf-342a-4fcf-a951-b953a53cdb67 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:34.376664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:34.377316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:34.377599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:34.377875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:34.378629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:34.380563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baf9f6-0ae8-4b38-b4f5-95e7674554d7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:34.401121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 505/1006] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:28:34 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:36.705170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb687-5124-4edb-a897-d5ea4bdcee3e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.705746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb687-5124-4edb-a897-d5ea4bdcee3e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.705746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beb687-5124-4edb-a897-d5ea4bdcee3e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.707547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 502/1007] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:36.714493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.715021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.715124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.737783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:36.740082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:36.748621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 506/1008] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:36.773332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb687-5124-4edb-a897-d5ea4bdcee3e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:36.786585 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beb687-5124-4edb-a897-d5ea4bdcee3e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:36.791389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:36.792269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.792552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.792824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] PATH_INFO: `/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.795020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] RBAC: Authorizing `identity:get_role(role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:36.796072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:36.796072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:28:36.796072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:28:36.797188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:36.798798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 503/1009] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:36 2021] GET /identity/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:36.805834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:36.816190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce389-b9ec-42f8-887a-af9454387315 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:36.820959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:36.821819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.822094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.822362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] PATH_INFO: `/v3/users/a42b1b81e2ce430ca74c372aba3c62ed` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.839504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] RBAC: Authorizing `identity:get_user(user_id=a42b1b81e2ce430ca74c372aba3c62ed)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:36.842886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:36.845084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 507/1010] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:36 2021] GET /identity/v3/users/a42b1b81e2ce430ca74c372aba3c62ed => generated 286 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:36.851765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:36.862801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a2f72-bcf1-43ee-bece-bd4e80eaf031 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:36.867459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:36.868106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.868390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.868662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.876942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:36.878790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:36.887804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 504/1011] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:36.894522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:36.905641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598f0f-7e0a-4a94-87c3-eeb6aeca8724 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:36.910387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:36.911282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.911564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.911842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.913034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:36.915305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b169c-27b1-4b88-933e-814003e30efb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:36.916996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 508/1012] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:36 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:36.924763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:36.933777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72837-071e-4dfd-b111-f7f35a1089f5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:36.938964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:36.939615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:36.939902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:36.940180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:36.941027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=233a02c8450f4e4594eb66d8b3cf1517, user.id=a42b1b81e2ce430ca74c372aba3c62ed) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:36.941341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:36.943234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a02c0c-6cea-49a1-b018-99fe111206f3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:36.949077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 505/1013] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:36 2021] GET /identity/v3/role_assignments?user.id=a42b1b81e2ce430ca74c372aba3c62ed&scope.project.id=233a02c8450f4e4594eb66d8b3cf1517&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:39.179604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddebc9-6e8c-4f1f-b2a6-dbbf03f35169 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.180119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddebc9-6e8c-4f1f-b2a6-dbbf03f35169 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.180229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddebc9-6e8c-4f1f-b2a6-dbbf03f35169 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.181924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 509/1014] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:39.188128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.188587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.188690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.206065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:39.207295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:39.215939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 506/1015] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:39.240180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddebc9-6e8c-4f1f-b2a6-dbbf03f35169 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:39.252439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddebc9-6e8c-4f1f-b2a6-dbbf03f35169 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:39.256892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:39.257736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.258018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.258291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] PATH_INFO: `/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.259812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] RBAC: Authorizing `identity:get_role(role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:39.260833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:39.260833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:28:39.260833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:28:39.261712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:39.263434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 510/1016] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:39 2021] GET /identity/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:39.269896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:39.285620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5b74-b7d3-4c01-8bb0-04abd79b6ea6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:39.290322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:39.291220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.291505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.291780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] PATH_INFO: `/v3/users/a42b1b81e2ce430ca74c372aba3c62ed` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.292999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] RBAC: Authorizing `identity:get_user(user_id=a42b1b81e2ce430ca74c372aba3c62ed)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:39.295956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:39.297583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 507/1017] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:39 2021] GET /identity/v3/users/a42b1b81e2ce430ca74c372aba3c62ed => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:39.304040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:39.313813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0ef58-81fb-4195-8623-df9c2b5c949e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:39.318416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:39.319275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.319559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.319835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.321002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:39.323084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f2866-ecdf-43b3-a934-5134fcf29ce1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:39.324717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 511/1018] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:39 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:39.331749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:39.342099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f51895-2aad-4b50-ae64-58844c1eabbb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:39.346704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:39.347519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:39.347804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:39.348080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517/users/a42b1b81e2ce430ca74c372aba3c62ed/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:39.350318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233a02c8450f4e4594eb66d8b3cf1517, user_id=a42b1b81e2ce430ca74c372aba3c62ed, role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:39.352974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b50981-7043-41a8-86a4-eb05ac281865 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:39.366186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 508/1019] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:39 2021] PUT /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517/users/a42b1b81e2ce430ca74c372aba3c62ed/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:28:41.603815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d855-4817-4215-868d-af30b3165dbb None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.604368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d855-4817-4215-868d-af30b3165dbb None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.604368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d855-4817-4215-868d-af30b3165dbb None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.606719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 512/1020] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:41.613043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.613451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.613603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.631807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:41.633005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:41.689778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 509/1021] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:41.714076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d855-4817-4215-868d-af30b3165dbb None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:41.726614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d855-4817-4215-868d-af30b3165dbb None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:41.731463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:41.732426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.732711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.732988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] PATH_INFO: `/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.734587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] RBAC: Authorizing `identity:get_role(role_id=0cebbf57b5c2446ab2a72aaea14093d6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:41.736444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:41.737747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 513/1022] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:41 2021] GET /identity/v3/roles/0cebbf57b5c2446ab2a72aaea14093d6 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:41.744666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:41.754448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0759-d829-4c72-b419-68d0d89a2c4a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:41.759029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:41.759889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.760168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.760440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] PATH_INFO: `/v3/users/a42b1b81e2ce430ca74c372aba3c62ed` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.761649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] RBAC: Authorizing `identity:get_user(user_id=a42b1b81e2ce430ca74c372aba3c62ed)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:41.763946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:41.765514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 510/1023] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:41 2021] GET /identity/v3/users/a42b1b81e2ce430ca74c372aba3c62ed => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:41.771539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:41.780775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91eb87-0294-4253-ae28-8c86f152195d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:41.785636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:41.786248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.786557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.786837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.794931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:41.796659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:41.805378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 514/1024] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:41.812055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:41.821338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756dd556-bd1c-4aee-8cca-27882845af13 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:41.825943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:41.826798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.827078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.827350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.828525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:41.830579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c134524-0ca4-4b9f-a640-d03cbbecadac admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:41.832195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 511/1025] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:41 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:41.838599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:41.847219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39477900-3f02-4c98-9d62-ac658a76122e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:41.851767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:41.852383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:41.852666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:41.852939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:41.853768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] RBAC: Adding query filter params (role.id=0cebbf57b5c2446ab2a72aaea14093d6, scope.project.id=233a02c8450f4e4594eb66d8b3cf1517, user.id=a42b1b81e2ce430ca74c372aba3c62ed) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:41.854120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:41.856433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712455f4-5554-41cd-b70f-df0ff88ef3d3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:41.862386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 515/1026] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:41 2021] GET /identity/v3/role_assignments?user.id=a42b1b81e2ce430ca74c372aba3c62ed&scope.project.id=233a02c8450f4e4594eb66d8b3cf1517&role.id=0cebbf57b5c2446ab2a72aaea14093d6 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:44.126378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66b3f-51f3-4c71-91a4-ea434df78bce None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:44.126866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66b3f-51f3-4c71-91a4-ea434df78bce None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:44.126973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66b3f-51f3-4c71-91a4-ea434df78bce None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:44.128773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 512/1027] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:44.134759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:44.135198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:44.135304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:44.152584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:44.154252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:44.161731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 516/1028] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:44.186939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66b3f-51f3-4c71-91a4-ea434df78bce None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:44.199744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66b3f-51f3-4c71-91a4-ea434df78bce None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:44.204248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:44.205025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:44.205310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:44.205583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:44.206796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:44.208468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c8b0-d19b-4101-bbe7-e788575b69f9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:44.210031 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 513/1029] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:44.217267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:44.226124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b9ad-669d-47ed-b7b5-5e7421b39821 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:44.230691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:44.231939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:44.232220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:44.232497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:44.233220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:44.235166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b616244-7fd1-41dd-88a4-9abc9492c341 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:44.260509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 517/1030] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:28:44 2021] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:46.552291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256481-9f50-496b-922c-c1de541bf15f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:46.552825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256481-9f50-496b-922c-c1de541bf15f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:46.552825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33256481-9f50-496b-922c-c1de541bf15f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:46.554642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 514/1031] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:46.561031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:46.561443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:46.561592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:46.580034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:46.581250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:46.640268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 518/1032] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:46.666654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33256481-9f50-496b-922c-c1de541bf15f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:46.689979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33256481-9f50-496b-922c-c1de541bf15f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:46.694434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:46.695245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:46.695529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:46.695803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:46.696986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:46.698706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ca2ba-02b5-4a9b-8a01-77c4c1674c27 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:46.701076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 515/1033] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:28:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:46.707636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:46.716811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97826ba8-3eaf-465f-a3bf-0968e0a2aad1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:46.721421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:46.722089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:46.722372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:46.722689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:46.723423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:46.725363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a196f-f125-4b67-84cc-576c30362365 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:46.745281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 519/1034] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:28:46 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:28:49.031717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af35ab-db5a-40b2-96e8-c23807d8711f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.032279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af35ab-db5a-40b2-96e8-c23807d8711f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.032279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af35ab-db5a-40b2-96e8-c23807d8711f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.034036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 516/1035] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:49.040018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.040443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.040576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.057923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:49.059877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:49.067602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 520/1036] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:49.092685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af35ab-db5a-40b2-96e8-c23807d8711f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.104823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af35ab-db5a-40b2-96e8-c23807d8711f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.109762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.110815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.111120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.111396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.121267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:49.128719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:49.129876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 517/1037] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:49.136523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.145987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4071-b791-4ba1-b3a9-ee26341c024f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.150426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.151104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.151385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.151658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.152417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:49.153123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:49.154737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:49.162731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 521/1038] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:49.169436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.179494 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4869-6b14-49fa-8e63-193da76cece7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.184728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.185571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.185854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.186131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] PATH_INFO: `/v3/users/389066dd705d4fa28396113080ef7aa0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.199043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] RBAC: Authorizing `identity:get_user(user_id=389066dd705d4fa28396113080ef7aa0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:49.201485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:49.203149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 518/1039] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/users/389066dd705d4fa28396113080ef7aa0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:49.209449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.219249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33bbd9-5be6-47b8-881b-a600b0066f8f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.223726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.224359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.224643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.224920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.233115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:49.234929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:49.243783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 522/1040] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:49.251371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.260705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d232053-dfe8-46ce-a258-a136686474ea admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.265704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.266572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.266853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.267124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] PATH_INFO: `/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.268303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] RBAC: Authorizing `identity:get_project(project_id=a2b87b47e7da48bdbc1bb23b106eef08)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:49.270347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c6802-8f81-48a6-9244-a2b687ee007e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:49.272008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 519/1041] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:49.278711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:49.287585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd44c8-82c7-44c3-aebd-a4fe37e47087 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:49.292134 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:49.292759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:49.293041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:49.293931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:49.295013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08, user.id=389066dd705d4fa28396113080ef7aa0) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:49.295328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:49.297166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9de83-67c5-4b1b-9d90-29ec069e913d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:49.302393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 523/1042] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:49 2021] GET /identity/v3/role_assignments?user.id=389066dd705d4fa28396113080ef7aa0&scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:28:51.551020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f563-778c-42b7-a7c9-743da67e92f1 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.551540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f563-778c-42b7-a7c9-743da67e92f1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.551540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f563-778c-42b7-a7c9-743da67e92f1 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.553326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 520/1043] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:51.559965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.560343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.560523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.577708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:51.578942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:51.586722 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 524/1044] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:51.610942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856f563-778c-42b7-a7c9-743da67e92f1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:51.624123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856f563-778c-42b7-a7c9-743da67e92f1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:51.628583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:51.629359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.629642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.629940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.640676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:51.647854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:51.649046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 521/1045] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:51.656029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:51.665135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff870b-4477-49d9-af56-249574d44aaa None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:51.670260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:51.670942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.671226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.671504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.672270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:51.672574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:51.674174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:51.682371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 525/1046] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:51.689999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:51.700773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c29f8e-76c5-4558-9fb7-d822cb4847b8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:51.705342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:51.706185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.706465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.706776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] PATH_INFO: `/v3/users/389066dd705d4fa28396113080ef7aa0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.707982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=389066dd705d4fa28396113080ef7aa0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:51.710097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:51.711696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 522/1047] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:51 2021] GET /identity/v3/users/389066dd705d4fa28396113080ef7aa0 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:51.718544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:51.728058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f816aa-77fa-4e58-80c1-8daefdd366c2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:51.733612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:51.734448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.734763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.735042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] PATH_INFO: `/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.736492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] RBAC: Authorizing `identity:get_project(project_id=a2b87b47e7da48bdbc1bb23b106eef08)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:51.738600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d4ff9-4bed-4971-a192-4e231fad51cc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:51.740238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 526/1048] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:51 2021] GET /identity/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:51.746940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:51.756370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55673b-0c3b-4f4e-8df9-e7db0d48e9c0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:51.760814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:51.761677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:51.762402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:51.762728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] PATH_INFO: `/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08/users/389066dd705d4fa28396113080ef7aa0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:51.764701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b87b47e7da48bdbc1bb23b106eef08, user_id=389066dd705d4fa28396113080ef7aa0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:51.767335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421011a-dd1e-465c-b0af-48a8315e30cf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:51.781122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 523/1049] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:28:51 2021] PUT /identity/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08/users/389066dd705d4fa28396113080ef7aa0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:28:54.051648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e79d5-7bd9-4a10-8e5e-720d2e6ee4d0 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.052189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e79d5-7bd9-4a10-8e5e-720d2e6ee4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.052189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e79d5-7bd9-4a10-8e5e-720d2e6ee4d0 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.053968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 527/1050] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:54.060413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.060803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.060970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.079169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:54.080376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:54.140126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 524/1051] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:54.164899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e79d5-7bd9-4a10-8e5e-720d2e6ee4d0 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.177707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e79d5-7bd9-4a10-8e5e-720d2e6ee4d0 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.182125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.183027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.183311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.183590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.194096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:28:54.201725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:28:54.202929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 528/1052] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:54.209596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.218576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31e6d-612b-4217-bb90-240f08816e12 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.223186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.223847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.224134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.224412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.225177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:54.225491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:54.227137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:54.235383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 525/1053] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:54.243829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.254991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deac3c-a39b-44cf-8693-5d86b8ca0327 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.259496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.260335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.260608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.260879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] PATH_INFO: `/v3/users/389066dd705d4fa28396113080ef7aa0` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.263233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] RBAC: Authorizing `identity:get_user(user_id=389066dd705d4fa28396113080ef7aa0)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:54.265499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:54.268087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 529/1054] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/users/389066dd705d4fa28396113080ef7aa0 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:54.273457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.283228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c475726-e34e-4a5c-b1f6-53fc18f3c65e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.287909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.288549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.288835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.289112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.296892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:54.298674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:54.307554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 526/1055] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:54.314801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.324999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e79158-3595-4095-b0bb-522386501520 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.329688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.330550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.330836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.331110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] PATH_INFO: `/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.332286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2b87b47e7da48bdbc1bb23b106eef08)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:54.334409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60022da6-04a4-4fb2-b3d0-8569fdb6c837 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:54.336064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 530/1056] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:54.343036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:54.351729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c02f3-8daf-4203-8108-700084b44109 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:54.357268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:54.357899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:54.358184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:54.358462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:54.359526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08, user.id=389066dd705d4fa28396113080ef7aa0) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:54.359837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:54.361911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fa953-36e9-4989-864e-a39cc4f4ee7a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:54.367689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 527/1057] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:28:54 2021] GET /identity/v3/role_assignments?user.id=389066dd705d4fa28396113080ef7aa0&scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:56.654807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5af6e-5fd6-476f-a02c-b2f0c92e3755 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:56.657515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5af6e-5fd6-476f-a02c-b2f0c92e3755 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:56.657515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5af6e-5fd6-476f-a02c-b2f0c92e3755 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:56.657515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 531/1058] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:28:56.663404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:56.663846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:56.664040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:56.682051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:56.683277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:56.691314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 528/1059] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:56.715759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5af6e-5fd6-476f-a02c-b2f0c92e3755 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:56.727833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5af6e-5fd6-476f-a02c-b2f0c92e3755 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:56.732339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:56.733266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:56.733266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:56.733525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:56.742740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:56.745399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:56.754609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 532/1060] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:28:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:28:56.761556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:56.771080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990e3e3-d910-49dd-b805-99ae7ebb366a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:56.775692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:56.776488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:56.776772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:56.777049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:56.784556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:56.786384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:56.800863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-ff2cb769-c74a-49a7-86df-172a921064a1 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 08:28:56.802008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 529/1061] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:28:56 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:28:56.808623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:56.817437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3813-47ae-40bd-8b61-ec796d724998 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:56.822604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:56.823375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:56.823717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:56.824000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:56.825267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:28:56.825617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:56.827224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc88af8-fb4a-4918-8742-10cbd99a183e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:56.834486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 533/1062] 10.222.0.76 () {56 vars in 1136 bytes} [Thu Oct 28 08:28:56 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:28:59.092584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0627-3121-474c-9138-aac853290b00 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:59.093136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0627-3121-474c-9138-aac853290b00 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:59.093136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0627-3121-474c-9138-aac853290b00 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:59.095418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 530/1063] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:28:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:28:59.101020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e006892-a8c9-49bb-8f85-dbaf58e364d5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:59.101422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e006892-a8c9-49bb-8f85-dbaf58e364d5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:59.101576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e006892-a8c9-49bb-8f85-dbaf58e364d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:59.120141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4e006892-a8c9-49bb-8f85-dbaf58e364d5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:28:59.122471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4e006892-a8c9-49bb-8f85-dbaf58e364d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:28:59.130022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 534/1064] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:28:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:28:59.153658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed0627-3121-474c-9138-aac853290b00 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:28:59.165701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed0627-3121-474c-9138-aac853290b00 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:28:59.170795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:28:59.171438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:28:59.171730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:28:59.172008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:28:59.172784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:28:59.173781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:28:59.173781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:28:59.173781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:28:59.174701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45aadf-e34d-492b-9060-c76736802c37 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:28:59.191551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 531/1065] 10.222.0.76 () {60 vars in 1159 bytes} [Thu Oct 28 08:28:59 2021] POST /identity/v3/domains => generated 267 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:29:01.460550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d99ed-dc06-4620-9b0b-df45686794bc None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:01.461096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d99ed-dc06-4620-9b0b-df45686794bc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:01.461096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d99ed-dc06-4620-9b0b-df45686794bc None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:01.462825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 535/1066] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:29:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:29:01.469382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:01.469863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:01.469966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:01.488666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:29:01.489881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:29:01.547462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 532/1067] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:29:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:29:01.572553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d99ed-dc06-4620-9b0b-df45686794bc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:01.585454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d99ed-dc06-4620-9b0b-df45686794bc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:01.589761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:01.591063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:01.591349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:01.591619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] PATH_INFO: `/v3/domains/a5b8dea5ae314253b295e3152ec1f462` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:01.601776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a5b8dea5ae314253b295e3152ec1f462)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:01.603789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6bdb4-c413-4f0e-a770-d2e2d32e047b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:01.606008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 536/1068] 10.222.0.76 () {56 vars in 1204 bytes} [Thu Oct 28 08:29:01 2021] GET /identity/v3/domains/a5b8dea5ae314253b295e3152ec1f462 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:01.612227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:01.621533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e933af-3a08-4185-982d-9b7b1901f12f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:01.626198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:01.626882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:01.627171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:01.627450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:01.628178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:01.630066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6c4a-f81f-4e59-87f2-479ab95b9b79 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:01.655240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 533/1069] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:29:01 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:29:03.947605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a451c-76fa-489c-8a7a-bb4151645bb1 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:03.948163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a451c-76fa-489c-8a7a-bb4151645bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:03.948163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a451c-76fa-489c-8a7a-bb4151645bb1 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:03.951079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 537/1070] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:29:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:29:03.956977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:03.957417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:03.957526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:03.975146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:29:03.976374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:29:04.032517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 534/1071] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:29:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:29:04.059507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a451c-76fa-489c-8a7a-bb4151645bb1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:04.071513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a451c-76fa-489c-8a7a-bb4151645bb1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:04.076784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:04.077628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:04.077908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:04.078185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] PATH_INFO: `/v3/domains/a5b8dea5ae314253b295e3152ec1f462` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:04.079431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a5b8dea5ae314253b295e3152ec1f462)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:04.081398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21b448-3beb-4a61-88f4-d6b569a0c6c5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:04.083020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 538/1072] 10.222.0.76 () {56 vars in 1204 bytes} [Thu Oct 28 08:29:04 2021] GET /identity/v3/domains/a5b8dea5ae314253b295e3152ec1f462 => generated 267 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:04.089278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:04.098386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb580-701e-4e87-9730-dc2bbbc0d63d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:04.102954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:04.103614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:04.103895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:04.104167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:04.104905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:04.107589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2c1e-c299-4509-aeb1-e727c07d44b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:04.127406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 535/1073] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:29:04 2021] POST /identity/v3/users => generated 311 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:29:06.410136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708829a4-45e7-4c86-90b0-bb0f90241954 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.410729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708829a4-45e7-4c86-90b0-bb0f90241954 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.410729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708829a4-45e7-4c86-90b0-bb0f90241954 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.412428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 539/1074] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:29:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:29:06.419230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.419747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.419747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.437575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:29:06.438793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:29:06.446468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 536/1075] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:29:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:29:06.471394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708829a4-45e7-4c86-90b0-bb0f90241954 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.484239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708829a4-45e7-4c86-90b0-bb0f90241954 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.488801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.489568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.489845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.490118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.501407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:29:06.508222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:29:06.509367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 540/1076] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:29:06.516174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.525210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a915a-06a2-4fcb-9442-b1813d98c370 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.530074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.530812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.531100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.531379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.532142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:29:06.532449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:06.534073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:06.542299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 537/1077] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:06.549249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.559442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e017e-6ecc-48a9-bbd9-52663fb408f4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.564061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.564907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.565193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.565581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] PATH_INFO: `/v3/users/4ebcff6e33c9428296fb7bb2ea52850f` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.578825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] RBAC: Authorizing `identity:get_user(user_id=4ebcff6e33c9428296fb7bb2ea52850f)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:06.580998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:06.582629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 541/1078] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/users/4ebcff6e33c9428296fb7bb2ea52850f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:06.589216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.599395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68855001-6387-4593-9c9b-7a430958c28a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.604269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.605483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.605815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.606186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.614345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:06.616129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:06.626162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 538/1079] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:29:06.632732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.642954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61632-2a13-4f00-bd45-4556fc7f2964 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.647973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.648882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.649207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.649525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] PATH_INFO: `/v3/projects/1e14d94113364c66a02c356044e7facf` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.650798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e14d94113364c66a02c356044e7facf)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:06.653054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a4c45-3b7f-4dbc-8841-e350b52ca8c0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:06.654812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 542/1080] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/projects/1e14d94113364c66a02c356044e7facf => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:06.661511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:06.671410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e2dc-8484-4e9f-a796-7709eca6209b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:06.676442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:06.677091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:06.677401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:06.677678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:06.678621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=1e14d94113364c66a02c356044e7facf, user.id=4ebcff6e33c9428296fb7bb2ea52850f) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:29:06.678986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:06.680970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662636e1-35fd-42f7-832d-f01e3d7a3c82 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:06.687433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 539/1081] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:29:06 2021] GET /identity/v3/role_assignments?user.id=4ebcff6e33c9428296fb7bb2ea52850f&scope.project.id=1e14d94113364c66a02c356044e7facf&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:08.989189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc096-753c-4aef-9722-8b07863e99db None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:08.989784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc096-753c-4aef-9722-8b07863e99db None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:08.989784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc096-753c-4aef-9722-8b07863e99db None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:08.991554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 543/1082] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:29:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:29:08.998194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:08.998650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:08.998783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.016264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:29:09.017461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:29:09.025294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 540/1083] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:29:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:29:09.050514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc096-753c-4aef-9722-8b07863e99db None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:09.062787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdc096-753c-4aef-9722-8b07863e99db None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:09.067284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:09.068088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:09.068374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:09.068651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.078873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:29:09.085798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:29:09.087053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 544/1084] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:29:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:29:09.094593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:09.103569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cf9df-db7d-4eb0-bcf1-fb4fe18026d7 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:09.109290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:09.109955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:09.110526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:09.110801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.111565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:29:09.111874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:09.113462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:09.121838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 541/1085] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:29:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:09.128320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:09.139386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81bf3-a298-4075-b38e-f96c9d9ddf4e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:09.144010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:09.144839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:09.145118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:09.145390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] PATH_INFO: `/v3/users/4ebcff6e33c9428296fb7bb2ea52850f` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.146580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] RBAC: Authorizing `identity:get_user(user_id=4ebcff6e33c9428296fb7bb2ea52850f)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:09.148682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:09.150230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 545/1086] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:29:09 2021] GET /identity/v3/users/4ebcff6e33c9428296fb7bb2ea52850f => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:09.157246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:09.167003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9a0e-7500-4a04-b44c-d310a7dc22b2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:09.172265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:09.173120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:09.173451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:09.173733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] PATH_INFO: `/v3/projects/1e14d94113364c66a02c356044e7facf` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.174956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] RBAC: Authorizing `identity:get_project(project_id=1e14d94113364c66a02c356044e7facf)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:09.177013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77d82c-d04c-46e1-bea1-313efc71ad8b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:09.178719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 542/1087] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:29:09 2021] GET /identity/v3/projects/1e14d94113364c66a02c356044e7facf => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:09.184983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:09.194451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348bdc9-1d8e-46cc-958d-00f14593a05e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:09.199314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:09.200175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:09.200480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:09.200725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] PATH_INFO: `/v3/projects/1e14d94113364c66a02c356044e7facf/users/4ebcff6e33c9428296fb7bb2ea52850f/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:09.202689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e14d94113364c66a02c356044e7facf, user_id=4ebcff6e33c9428296fb7bb2ea52850f, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:09.205303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a4858-9a1a-49ae-b795-9ec465651eff admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:09.219069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 546/1088] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:29:09 2021] PUT /identity/v3/projects/1e14d94113364c66a02c356044e7facf/users/4ebcff6e33c9428296fb7bb2ea52850f/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:29:11.442565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f1e7-1f9c-4324-b98d-4939538906b6 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.443083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f1e7-1f9c-4324-b98d-4939538906b6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.443177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f1e7-1f9c-4324-b98d-4939538906b6 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.444913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 543/1089] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:29:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:29:11.451471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.452165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.452399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.473148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:29:11.473148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:29:11.528140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 547/1090] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:29:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:29:11.552425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f1e7-1f9c-4324-b98d-4939538906b6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.565166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f1e7-1f9c-4324-b98d-4939538906b6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.569576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.570352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.570672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.570950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.581740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:29:11.588685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:29:11.589860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 544/1091] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:29:11.596503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.606244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4452-217e-4186-80a3-b242d7ddafdc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.611400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.612049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.612334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.612609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.613373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:29:11.613676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:11.615423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:11.624346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 548/1092] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:11.630905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.640993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8247-fca8-4cfd-bdaf-d1074f53804f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.645438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.646275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.646585 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.646853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] PATH_INFO: `/v3/users/4ebcff6e33c9428296fb7bb2ea52850f` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.648050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] RBAC: Authorizing `identity:get_user(user_id=4ebcff6e33c9428296fb7bb2ea52850f)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:11.650153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:11.651757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 545/1093] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/users/4ebcff6e33c9428296fb7bb2ea52850f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:11.657831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.667273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7de5-b777-441c-9dde-443281a48384 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.672420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.673045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.673333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.673611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.681286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:11.683664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:11.692530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 549/1094] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:29:11.699467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.708876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c78aff-bb25-4cf1-ad74-1cd37d248693 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.713347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.714186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.715010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.715291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] PATH_INFO: `/v3/projects/1e14d94113364c66a02c356044e7facf` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.716509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] RBAC: Authorizing `identity:get_project(project_id=1e14d94113364c66a02c356044e7facf)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:11.718582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94944e-880d-45fd-8592-a019666e565d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:11.720206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 546/1095] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/projects/1e14d94113364c66a02c356044e7facf => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:29:11.727464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:29:11.736926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5c2ea-c0f0-4e9d-9137-4cf2ad4556eb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:29:11.741480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:29:11.742101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:29:11.742383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:29:11.742692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:29:11.743535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=1e14d94113364c66a02c356044e7facf, user.id=4ebcff6e33c9428296fb7bb2ea52850f) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:29:11.743873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:29:11.746426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865299-9eca-42cc-ba17-b3629abf7bf1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:29:11.752064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 550/1096] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:29:11 2021] GET /identity/v3/role_assignments?user.id=4ebcff6e33c9428296fb7bb2ea52850f&scope.project.id=1e14d94113364c66a02c356044e7facf&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:08.068473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293033-bad6-46dd-bf56-4efdd9e7a447 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:08.069116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293033-bad6-46dd-bf56-4efdd9e7a447 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:08.069116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33293033-bad6-46dd-bf56-4efdd9e7a447 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:08.071068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 547/1097] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:08.078927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623b38-e365-4709-b728-54108fda055f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:08.078927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623b38-e365-4709-b728-54108fda055f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:08.078927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623b38-e365-4709-b728-54108fda055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:08.097218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b6623b38-e365-4709-b728-54108fda055f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:08.099447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b6623b38-e365-4709-b728-54108fda055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:08.110650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 551/1098] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:08.134660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33293033-bad6-46dd-bf56-4efdd9e7a447 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:08.149139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33293033-bad6-46dd-bf56-4efdd9e7a447 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:08.154527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:08.155373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:08.155666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:08.155974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:08.168062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:08.170066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:08.189247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:08.194270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 548/1099] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:08.197918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623b38-e365-4709-b728-54108fda055f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:08.210972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623b38-e365-4709-b728-54108fda055f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:08.217981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:08.218947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:08.219437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:08.219696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:08.220602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:08.220987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:08.222867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a3525-d43d-485e-9de4-eb23ef46d9b6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:08.238261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 552/1100] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:08.244974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:08.255469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a6dbe-465e-45f5-ba1f-95aff35ad6fb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:08.264262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:08.265114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:08.265550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:08.265891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:08.266711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:08.268780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c31f-4ee1-4865-bd9d-89e0de0a9b73 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:08.293292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 549/1101] 10.222.0.76 () {60 vars in 1153 bytes} [Thu Oct 28 08:30:08 2021] POST /identity/v3/users => generated 251 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:30:10.993777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc25-c83c-469a-928a-6ffb699878fa None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:10.994417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc25-c83c-469a-928a-6ffb699878fa None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:10.994546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939dc25-c83c-469a-928a-6ffb699878fa None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:10.996521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 553/1102] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:11.006604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.006604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.006604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.036918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:11.041861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:11.053761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 550/1103] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:11.083318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939dc25-c83c-469a-928a-6ffb699878fa None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.101817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939dc25-c83c-469a-928a-6ffb699878fa None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.108100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.109412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.109734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.110016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.124340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:11.134171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:30:11.138580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 554/1104] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:11.143492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.154757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5370672-99d8-4728-827f-58e724c35cd6 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.161229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.162073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.162566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.162754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.163649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.164201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.166280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.176966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 551/1105] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:11.185282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.198265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9e508-f8e2-454f-b795-db2b5b9d11fd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.204017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.204836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.205123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.205403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.221856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.224310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.252156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:11.254170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 555/1106] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:11.263821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.277910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa53ce-b9e0-474f-838d-e8256991522e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.282846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.283518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.283796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.284061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.285168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.285602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.287781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.312479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 552/1107] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:11.313706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.324969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476152de-5143-4471-a56f-f6c7e219285f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.330465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.331286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.331570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.331933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.339991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.342433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.357169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:11.358429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 556/1108] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:11.365602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.376571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9001-4d04-4d7a-ac8a-649206da2610 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.384990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.385902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.386247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.386544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.387364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.387689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.389562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.413921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 553/1109] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:11.415954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.426394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f3e1-4bd1-4243-a01a-e1bc38d34a61 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.432136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.432931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.433219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.433499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.442868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.443658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.454477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 557/1110] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:30:11.461512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.472886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de4e6-46ae-43b5-913e-b17d84352472 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.480005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.480921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.481304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.481694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.499626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.502447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.523323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:11.525325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 554/1111] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:11.531560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.542861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2eee2-4e65-4661-a78d-94c366615ad0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.547605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.548253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.548546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.548813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.549559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.549863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.552447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.566351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 558/1112] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:11.574180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.584600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee425a-89cb-4735-b1c6-878bd6fdfd1d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.589977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.590819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.591104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.591376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.598957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.600910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.615047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:11.616256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 555/1113] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:11.623589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.634687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392521ca-5770-4dc2-aad3-791825a34deb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.640377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.641176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.641557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.641912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.642855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.643251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.646144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d54d5-8f14-438f-9cd0-210b9809e653 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.659691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 559/1114] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:11.668113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:11.679957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e02dd8-d12c-4569-8830-62ecd468d261 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:11.685381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:11.686044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:11.686334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:11.686652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:11.687788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=f4a2cc4165da43ac97a20b324eb1d3de) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:11.688163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:11.690531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd5c04-1769-434b-815e-c6616ff2a3fd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:11.702652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 556/1115] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:30:11 2021] GET /identity/v3/role_assignments?user.id=f4a2cc4165da43ac97a20b324eb1d3de&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:14.204325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e92b-0908-4674-8515-13e60dd09033 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.204830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e92b-0908-4674-8515-13e60dd09033 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.204908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e92b-0908-4674-8515-13e60dd09033 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.210551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 560/1116] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:14.213337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.213781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.213887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.238380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:14.240380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:14.254521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 557/1117] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:14.278525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e92b-0908-4674-8515-13e60dd09033 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.291947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e92b-0908-4674-8515-13e60dd09033 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.298640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.299683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.299812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.300132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.313038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:14.320356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:30:14.326546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 561/1118] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:14.330669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.342754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae24c-6076-4d4b-904a-7ab9c8864935 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.348925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.349573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.349886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.350188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.351096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:14.351490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.353489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.364104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 558/1119] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:14.372625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.391962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554e5c2-102a-4431-b96a-70a04bdd0768 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.398170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.399011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.399556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.400045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.412280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.414106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.441947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:14.449180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 562/1120] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:14.450656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.460639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d96-d227-4cbc-a21b-ae4f4ba52f57 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.466571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.467309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.467641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.467921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.468839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:14.469212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.470956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.489536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 559/1121] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:14.498628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.518990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548c991-cf9c-4a24-9c90-a71e045df767 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.524214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.525369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.525920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.526310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.537873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.540763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.561094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:14.562485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 563/1122] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:14.569290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.581389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babd8dd-b2c2-4299-998e-e95e1e5ce014 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.586529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.587522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.587963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.588340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.589378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:14.589790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.591806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.624885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 560/1123] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:14.626281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.639603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0fec-c885-472d-aefd-9a6414a74c47 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.647590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.648746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.649319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.649988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.664491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.666610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.689119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:14.694673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 564/1124] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:14.697545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.709312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0381e0a-8280-40da-830a-0b6c3e5b56d3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.720840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.721571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.721840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.722129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.724207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:14.724505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.726136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.748181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 561/1125] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:14.754632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.779291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b1d4-1179-4b18-b40b-b7e654d933a9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.788209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.789118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.789407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.789698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.798008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.800059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.818551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:14.822742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 565/1126] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:14.830260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.844530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f25223-3778-450c-ac85-ec950b2632ac admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.850323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.851193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.851478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.851749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.852754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:14.853612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.855530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00b8e-33b6-4ea5-8441-e2513f8c108c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.879402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 562/1127] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:14.887195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:14.902425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82688-7a8a-4b7a-9e2c-afb379c30081 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:14.908604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:14.909481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:14.909812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:14.910068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/f4a2cc4165da43ac97a20b324eb1d3de/roles/1d41a4d25abd49dca61b68c3fdad6562` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:14.934037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=f4a2cc4165da43ac97a20b324eb1d3de, role_id=1d41a4d25abd49dca61b68c3fdad6562)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:14.938629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa0c5f-3556-4e9b-ac43-763b02f3607a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:14.962621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 566/1128] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:30:14 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/f4a2cc4165da43ac97a20b324eb1d3de/roles/1d41a4d25abd49dca61b68c3fdad6562 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:30:17.459247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a670a-e231-4ab8-809c-4921d8411e52 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.459796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a670a-e231-4ab8-809c-4921d8411e52 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.459796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a670a-e231-4ab8-809c-4921d8411e52 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.462285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 563/1129] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:17.469434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.469974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.469974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.490606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:17.491826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:17.561654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 567/1130] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:17.590210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a670a-e231-4ab8-809c-4921d8411e52 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.604384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a670a-e231-4ab8-809c-4921d8411e52 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.610043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.610982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.611274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.611554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.628305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:17.636131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 08:30:17.637368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 564/1131] 10.222.0.76 () {56 vars in 1123 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:17.644472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.655401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89899e7-bd8b-4a39-b231-26ff914c45f3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.660559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.661612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.662003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.662336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.663324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:17.663692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.665936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.676063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 568/1132] 10.222.0.76 () {56 vars in 1124 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:17.683701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.694353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faecd4-5aa2-4167-bfc3-f8abf394719e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.699812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.700602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.700884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.701158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.712469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.714396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.732712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:17.734588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 565/1133] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:17.741153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.751650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9fe45-d5df-4902-902e-533a14b3bd54 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.756923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.757591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.757864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.758142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.759601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:17.759775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.761390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.773235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 569/1134] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:17.780305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.791859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecb875-b294-45aa-8712-94c62603d6b5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.796526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.797321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.797682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.797960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.806325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.808994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.826361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:17.827584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 566/1135] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:17.834137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.848598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ebc49-5bc6-47d5-b121-c3df4a2cb406 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.854741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.855516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.855718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.856018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.856856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:17.857255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.859452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.879011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 570/1136] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:17.886299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.896316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b3268-225f-4dff-a1e0-e6013d4ef44c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.903185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.903909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.904299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.904657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.915389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.916915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.928128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 567/1137] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:30:17.936656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:17.949878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea21f5-b1cd-481c-bf62-672b8df300d5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:17.955379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:17.956345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:17.956849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:17.957214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:17.969906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:17.972262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:17.992660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:17.994792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 571/1138] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:18.001187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:18.011792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f7514-269e-4f3e-84e3-45c88ffde982 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:18.016941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:18.017607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:18.017910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:18.018176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:18.018958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:18.019262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:18.020902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:18.042236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 568/1139] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:18.043518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:18.053669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b6bf-8d22-486d-ac90-6c772349c4ac admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:18.059900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:18.060744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:18.061060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:18.061347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:18.068864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:18.071546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:18.086198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:18.087879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 572/1140] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:18.094911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:18.105868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf41f0-8fff-4174-b906-19ee6dbe240f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:18.111319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:18.112044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:18.112332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:18.112612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:18.113595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:18.113890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:18.115811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b34550-7dbe-4ca4-86fa-ea7a2a62fd18 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:18.129608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 569/1141] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:18.138739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:18.151100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e917-d92b-45e9-a762-698a5fb25905 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:18.156912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:18.157616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:18.157899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:18.158176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:18.159064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] RBAC: Adding query filter params (role.id=1d41a4d25abd49dca61b68c3fdad6562, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=f4a2cc4165da43ac97a20b324eb1d3de) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:18.159376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:18.161632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d56de0-5e83-4c95-ae7e-ccca50a4c129 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:18.169268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 573/1142] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:30:18 2021] GET /identity/v3/role_assignments?user.id=f4a2cc4165da43ac97a20b324eb1d3de&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=1d41a4d25abd49dca61b68c3fdad6562 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:20.772121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf413-a213-4d5b-9736-95966adeb99d None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:20.772658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf413-a213-4d5b-9736-95966adeb99d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:20.772658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf413-a213-4d5b-9736-95966adeb99d None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:20.775141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 570/1143] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:20.782064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:20.782676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:20.782676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:20.804419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:20.806656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:20.815300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 574/1144] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:20.843449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaf413-a213-4d5b-9736-95966adeb99d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:20.860659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaf413-a213-4d5b-9736-95966adeb99d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:20.866893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:20.868523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:20.868894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:20.869323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:20.884433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:20.893418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:30:20.894897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 571/1145] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:30:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:20.905143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:20.922763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d83b-a057-4a2c-8612-2ac5f22837e9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:20.929025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:20.929898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:20.930406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:20.930920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:20.932682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:20.933007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:20.935153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:20.947111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 575/1146] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:30:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:20.956846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:20.973668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4a44-1df7-407a-b41a-cdfebebf0363 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:20.980655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:20.981562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:20.981891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:20.982208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:20.999919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.002114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.025707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:21.026934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 572/1147] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:21.033776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.048205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708228b-a746-4e91-aa86-43aa121b394a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.055472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.056299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.056691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.057051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.057979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:21.058366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.060223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.074454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 576/1148] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:21.082777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.099476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc3d17-95cd-4d65-ad14-e61be06e0284 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.107082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.107917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.108199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.108782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.117286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.119554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.137756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:21.139218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 573/1149] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/users/placement => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:21.146787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.159562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251c71-7558-4a73-b0aa-d3d8def6bc66 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.166281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.167147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.167502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.167931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.168954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:21.169308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.171520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.194416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 577/1150] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:21.202445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.218883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69fff-8471-4ca2-b729-c11974554911 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.224380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.225071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.225463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.225820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.238278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.241165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.254787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 574/1151] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:30:21.262562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.277871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ecb1-e8fe-4bab-ac7e-e72f471e004f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.284369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.285236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.285520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.285817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.299060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.301187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.323420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:21.324815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 578/1152] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:21.331815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.343155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8501-a000-484b-838d-7a29eefbdb80 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.349062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.349602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.349943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.350340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.351285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:21.351838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.353513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.368245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 575/1153] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:21.377544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.387280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd7a94-94d6-4016-a3ed-327fb0882ea3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.392107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.393012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.393280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.393599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.404339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.406573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.421767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:21.431287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 579/1154] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:21.433500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.451322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163133-eb04-4f83-8b58-bdc70481f87e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.459012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.460176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.460695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.461186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.463354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:21.463911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.467227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eec1f-67f5-4303-b793-46cddc005e10 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.482017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 576/1155] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:30:21.490026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:21.507855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0aa62-2b73-4d60-80dc-0f062f250295 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:21.515527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:21.516434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:21.516850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:21.517203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:21.518252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=f4a2cc4165da43ac97a20b324eb1d3de) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:21.518583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:21.520459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e038ad-d0d2-413b-b75a-6474a4c50320 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:21.529903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 580/1156] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:30:21 2021] GET /identity/v3/role_assignments?user.id=f4a2cc4165da43ac97a20b324eb1d3de&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.103449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011b4a-482b-4e68-b483-2ef232333b9b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.104118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011b4a-482b-4e68-b483-2ef232333b9b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.104400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011b4a-482b-4e68-b483-2ef232333b9b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.107766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 577/1157] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:24 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:24.116935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.117453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.117453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.139769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:24.141108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:24.150584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 581/1158] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:24.197273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011b4a-482b-4e68-b483-2ef232333b9b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.218212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011b4a-482b-4e68-b483-2ef232333b9b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.223897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.224865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.225222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.225736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.243641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:24.251812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:30:24.253776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 578/1159] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:30:24.268714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.279459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcdf36-e356-4691-90f8-cc5b98d88b69 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.285209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.286664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.287556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.288011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.289087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:24.289481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.291506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.301122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 582/1160] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.313128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.330172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e38b4-5d26-4c47-8db1-f8a422dea479 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.337704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.338631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.338919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.339199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.353258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.354828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.375568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:24.378557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 579/1161] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:24.385047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.395373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bfdac-d0ad-4917-97cb-16bf1cbbe5e9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.403403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.404820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.405434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.406034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.407418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:24.407854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.411472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.435732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 583/1162] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.442935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.455815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecb47-ad31-45ed-af67-7ab357f972ef admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.461661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.462963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.463254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.463618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.474530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.476662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.495739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:24.497718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 580/1163] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:24.504762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.517618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530693b6-d84b-485b-bb73-2d72737669fc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.523393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.524831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.525313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.525428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.530747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:24.530747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.531107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.557027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 584/1164] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.565191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.575239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd283da2-aeac-4b34-9c6c-b97c8c2f77c6 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.580214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.581038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.581321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.581600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.593794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.595742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.616586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:24.618868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 581/1165] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:24.625375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.638920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49f32a-089e-4d99-831a-831892bd65bc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.646396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.647295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.647820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.648333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.649925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:24.650313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.652691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.667717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 585/1166] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.674735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.688621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60570a-1453-4823-9673-856bbd9a5831 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.694120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b097-f591-4288-819a-895598377eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.694996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b097-f591-4288-819a-895598377eae admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.695300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b097-f591-4288-819a-895598377eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.695645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b097-f591-4288-819a-895598377eae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.704249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b097-f591-4288-819a-895598377eae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.706719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b097-f591-4288-819a-895598377eae admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.722411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-2e08b097-f591-4288-819a-895598377eae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:24.724080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 582/1167] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 08:30:24.732795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.752602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448e0f6-6b45-4c24-820b-94f5eff5ba36 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.757912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.758649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.758928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.759242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.760032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:24.760338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.762311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ff2ef-5ff7-49c5-9205-1300d3114fc2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.777371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 586/1168] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:24.787596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b097-f591-4288-819a-895598377eae admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:24.799726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b097-f591-4288-819a-895598377eae admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:24.805415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:24.806393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:24.806706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:24.807021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] PATH_INFO: `/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/f4a2cc4165da43ac97a20b324eb1d3de/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:24.809208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807df4a12144351ac01f45b9dc31bed, user_id=f4a2cc4165da43ac97a20b324eb1d3de, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:24.812009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95740aa9-09f1-4b2e-8359-6de97ec8b68a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:24.828827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 583/1169] 10.222.0.76 () {58 vars in 1460 bytes} [Thu Oct 28 08:30:24 2021] PUT /identity/v3/projects/3807df4a12144351ac01f45b9dc31bed/users/f4a2cc4165da43ac97a20b324eb1d3de/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:30:27.560453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c220-5644-4fcb-a40a-cc81004f4d3c None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.561016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c220-5644-4fcb-a40a-cc81004f4d3c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.561016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932c220-5644-4fcb-a40a-cc81004f4d3c None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.562926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 587/1170] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:27.569318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.569828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.569920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.589843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:27.591161 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:27.654668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 584/1171] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:27.682028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932c220-5644-4fcb-a40a-cc81004f4d3c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.695007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932c220-5644-4fcb-a40a-cc81004f4d3c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.700036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.700851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.701137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.701415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.713419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 08:30:27.720534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 08:30:27.721794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 588/1172] 10.222.0.76 () {56 vars in 1117 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:27.729387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.746472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de1e63-1634-4a0d-ae94-6081504f1a95 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.751105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.751780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.752060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.752329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.753102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:27.753407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:27.755053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:27.764550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 585/1173] 10.222.0.76 () {56 vars in 1120 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:27.773529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.788531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766fa9-a906-4681-84c7-74ae729c88e7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.795621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.796761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.797179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.797598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.812258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:27.815174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:27.836872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:27.838525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 589/1174] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:27.847049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.861364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75667540-dcae-4cf5-bc75-68f505140d7f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.868154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.869140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.869587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.869928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.871033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:27.871500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:27.873706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:27.891633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 586/1175] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:27.898274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.910073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab289d-b274-4346-aac2-5a8ba4945b18 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.915872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.916679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.916962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.917233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.925360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:27.927454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:27.944051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 08:30:27.945295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 590/1176] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:27.955425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:27.967096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a582d75-f8ab-4bb1-a57d-6c8f9e920e68 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:27.971726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:27.972397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:27.972685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:27.972964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:27.973831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:27.974140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:27.976077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:27.995697 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 587/1177] 10.222.0.76 () {56 vars in 1164 bytes} [Thu Oct 28 08:30:27 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:28.002814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.013315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fefff3-6dd5-4f7d-b5c8-bd67715d30a8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.017991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.018665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.018978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.019255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.028465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.030249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.040642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 591/1178] 10.222.0.76 () {58 vars in 1324 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:30:28.048702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.059718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa2a9-b967-4499-ae04-8cd2b03cdf02 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.064711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.065458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.065745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.066056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.077569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.079515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.098646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 08:30:28.099889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 588/1179] 10.222.0.76 () {56 vars in 1129 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:28.107303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.120154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8d5c-97c9-452b-9578-c921182a2166 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.125583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.126246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.126614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.127074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.128073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:28.128375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.129974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.145098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 592/1180] 10.222.0.76 () {56 vars in 1130 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:28.152794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.169498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e83abe-a3af-4835-8db7-df03bf698e3c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.176710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.178018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.178464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.178920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.190620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.194292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.219695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING keystone.server.flask.application [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 08:30:28.221787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 589/1181] 10.222.0.76 () {56 vars in 1132 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:28.229733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.240783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e30f7e-a1a4-4541-b01f-fdaeef63c77e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.247091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.247985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.248463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.248783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.249753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:28.250135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.253367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f537a-8bf4-459d-9773-815fb0becfe4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.277346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 593/1182] 10.222.0.76 () {56 vars in 1169 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:28.285441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:28.297313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd93ccb-2968-40d0-ac79-efe62da0ca80 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:28.302198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:28.302907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:28.303202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:28.303470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:28.304447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] RBAC: Adding query filter params (role.id=cd529a78508a4af5ae28fe4417bc6cae, scope.project.id=3807df4a12144351ac01f45b9dc31bed, user.id=f4a2cc4165da43ac97a20b324eb1d3de) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:28.304766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:28.306731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8b352-b601-49db-b58d-fefbd50d2ced admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:28.313214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 590/1183] 10.222.0.76 () {56 vars in 1395 bytes} [Thu Oct 28 08:30:28 2021] GET /identity/v3/role_assignments?user.id=f4a2cc4165da43ac97a20b324eb1d3de&scope.project.id=3807df4a12144351ac01f45b9dc31bed&role.id=cd529a78508a4af5ae28fe4417bc6cae => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:30.895531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b76c-41a2-4832-83e5-0982cd6c7a9b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:30.896076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b76c-41a2-4832-83e5-0982cd6c7a9b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:30.896076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b76c-41a2-4832-83e5-0982cd6c7a9b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:30.897918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 594/1184] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:30:30.905994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:30.906905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:30.906905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:30.931282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:30.933947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:30.949296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 591/1185] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:30.976492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b76c-41a2-4832-83e5-0982cd6c7a9b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:30.992698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b76c-41a2-4832-83e5-0982cd6c7a9b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:30.997695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:30.999150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:30.999150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:30.999397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:31.000041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:31.001696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:31.019589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 08:30:31.020897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 595/1186] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:30:30 2021] GET /identity/v3/services/placement => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:31.028856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:31.039601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe91158-af9d-4daf-b8b1-e10380d6acd5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:31.046759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:31.047633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:31.048023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:31.048384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:31.049211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:31.049699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:31.052432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea565ac-53f4-4983-8b66-fbb3b19a29b2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:31.060787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 592/1187] 10.222.0.76 () {56 vars in 1137 bytes} [Thu Oct 28 08:30:31 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:31.068165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:31.079408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37525f-82b7-4752-94dd-52a9db140c5b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:31.084226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:31.084790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:31.085078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:31.085350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] PATH_INFO: `/v3/services` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:31.086166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:31.086468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:31.088163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da40ecb-b06d-4369-a186-c87f630efcc7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:31.094902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 596/1188] 10.222.0.76 () {56 vars in 1137 bytes} [Thu Oct 28 08:30:31 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:33.463843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fdf1d-a028-4ac8-9046-22ae117aed40 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:33.464332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fdf1d-a028-4ac8-9046-22ae117aed40 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:33.464332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fdf1d-a028-4ac8-9046-22ae117aed40 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:33.466098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 593/1189] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:33.472383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02e95-4eac-4153-a6b4-7ed26ec3a09c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:33.472832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02e95-4eac-4153-a6b4-7ed26ec3a09c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:33.472924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02e95-4eac-4153-a6b4-7ed26ec3a09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:33.491746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-86e02e95-4eac-4153-a6b4-7ed26ec3a09c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:33.493326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-86e02e95-4eac-4153-a6b4-7ed26ec3a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:33.501561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 597/1190] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:33.527176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fdf1d-a028-4ac8-9046-22ae117aed40 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:33.541271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fdf1d-a028-4ac8-9046-22ae117aed40 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:33.546039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:33.546810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:33.547096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:33.547374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:33.548138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:33.549760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c18c2b-a0b4-43b8-bddf-dbdd67f83fd8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:33.567726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 594/1191] 10.222.0.76 () {60 vars in 1162 bytes} [Thu Oct 28 08:30:33 2021] POST /identity/v3/services => generated 246 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:30:35.905707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155fa9-4230-4d15-83ba-cb5f683ad35f None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:35.906304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155fa9-4230-4d15-83ba-cb5f683ad35f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:35.906304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155fa9-4230-4d15-83ba-cb5f683ad35f None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:35.908890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 598/1192] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:35.916997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:35.917502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:35.918066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:35.940340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:35.941641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:35.960388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 595/1193] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:35.986119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa155fa9-4230-4d15-83ba-cb5f683ad35f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:35.999367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa155fa9-4230-4d15-83ba-cb5f683ad35f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:36.004562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:36.005373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:36.005834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:36.005950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:36.006620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:36.008314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:36.020471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 08:30:36.021723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 599/1194] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:30:35 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:36.029260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:36.038727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0a9d6-4c13-440a-a45b-b90449797751 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:36.045118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:36.045812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:36.046097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:36.046372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:36.047139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:36.047445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:36.049048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:36.057056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 596/1195] 10.222.0.76 () {56 vars in 1137 bytes} [Thu Oct 28 08:30:36 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:36.063900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:36.075633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa50d-f662-4973-a3df-432cc72fd813 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:36.080419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:36.081083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:36.081373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:36.081649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:36.082471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] RBAC: Adding query filter params (interface=public, service_id=3a9db812d2e149ea8383442585c0db80, region_id=RegionOne) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:36.082969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:36.084538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f9558-bc54-4694-9ce3-1de33b397fb2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:36.093341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 600/1196] 10.222.0.76 () {56 vars in 1272 bytes} [Thu Oct 28 08:30:36 2021] GET /identity/v3/endpoints?service_id=3a9db812d2e149ea8383442585c0db80&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:36.102900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:36.120789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3601b920-2652-4fbd-8b82-f55661b5210f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:36.128584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:36.129628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:36.130083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:36.130576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:36.131749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:36.134711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc921cdf-443e-441e-9672-b1b99816ca54 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:36.147734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 597/1197] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:30:36 2021] GET /identity/v3/services => generated 2191 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:30:38.570970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebb7f-97b4-4030-a276-c88b218b5122 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:38.571553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebb7f-97b4-4030-a276-c88b218b5122 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:38.571553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ebb7f-97b4-4030-a276-c88b218b5122 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:38.573297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 601/1198] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:30:38.579339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:38.579828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:38.579928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:38.604256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:30:38.606367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:30:38.620083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 598/1199] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:30:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:30:38.644287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ebb7f-97b4-4030-a276-c88b218b5122 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:38.656393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ebb7f-97b4-4030-a276-c88b218b5122 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:38.660776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:38.661547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:38.661830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:38.662108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:38.662807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:38.664945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:38.675724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING keystone.server.flask.application [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 08:30:38.676850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 602/1200] 10.222.0.76 () {56 vars in 1138 bytes} [Thu Oct 28 08:30:38 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 08:30:38.684175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:38.692986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4bbf-b3b1-4193-bda0-3f69e2e62a20 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:38.697821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:38.698482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:38.698798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:38.699064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] PATH_INFO: `/v3/services` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:38.699781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:30:38.700082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:38.701653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5300d3-778c-4017-8172-aebef05b3da1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:38.706701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 599/1201] 10.222.0.76 () {56 vars in 1137 bytes} [Thu Oct 28 08:30:38 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:30:38.712838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:30:38.722631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6316e7-e8b8-4cc9-931c-d57de432f189 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:30:38.727878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:30:38.728497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:30:38.728799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:30:38.729079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:30:38.729826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:30:38.731424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a79c2f-9340-4ddb-9ea5-43f99019232b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:30:38.750012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 603/1202] 10.222.0.76 () {60 vars in 1165 bytes} [Thu Oct 28 08:30:38 2021] POST /identity/v3/endpoints => generated 331 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:31:45.624877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:45.625365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:45.625449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:45.627608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 600/1203] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:45.633973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a187f1-c2a0-4a78-82fd-72ce3126af9f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:45.634520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a187f1-c2a0-4a78-82fd-72ce3126af9f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:45.634630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a187f1-c2a0-4a78-82fd-72ce3126af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:45.751611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-35a187f1-c2a0-4a78-82fd-72ce3126af9f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:45.753045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-35a187f1-c2a0-4a78-82fd-72ce3126af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:45.896281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 604/1204] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:31:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:45.925952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:45.928314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:46.079512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf32e25-79f1-48d2-a083-8cf0b036c0d9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:46.178878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:46.179478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:46.179930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:46.180331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:46.181674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:46.183727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eceffb-ec9c-4e99-bb09-eb2c32c9f981 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:46.214569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 601/1205] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:31:45 2021] GET /identity/v3/projects => generated 2553 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:31:48.572754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561518-8ced-4470-af96-adc47f501ca9 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:48.573279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561518-8ced-4470-af96-adc47f501ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:48.573367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561518-8ced-4470-af96-adc47f501ca9 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:48.575135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 605/1206] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:31:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:48.580942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0cf26-24d0-4408-b9a1-f7425b12f862 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:48.581366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0cf26-24d0-4408-b9a1-f7425b12f862 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:48.581514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0cf26-24d0-4408-b9a1-f7425b12f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:48.663205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f2b0cf26-24d0-4408-b9a1-f7425b12f862 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:48.664440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f2b0cf26-24d0-4408-b9a1-f7425b12f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:48.757786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 602/1207] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:31:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:48.808694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:48.808984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:48.809267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:48.811129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 606/1208] 10.222.0.76 () {54 vars in 964 bytes} [Thu Oct 28 08:31:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:48.817788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521ac7-1d0d-4911-8f43-268a6d5333ca None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:48.818154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521ac7-1d0d-4911-8f43-268a6d5333ca None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:48.818368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521ac7-1d0d-4911-8f43-268a6d5333ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:48.893969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6c521ac7-1d0d-4911-8f43-268a6d5333ca None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:48.895325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6c521ac7-1d0d-4911-8f43-268a6d5333ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:48.974597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 603/1209] 10.222.0.76 () {58 vars in 1061 bytes} [Thu Oct 28 08:31:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:48.984874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:48.986484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:49.095204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b713cb-9d54-41dc-84a4-51160fad3a54 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:49.169696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:49.170248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:49.170580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:49.170867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:49.172543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:49.280621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:49.282067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d376e89-6c32-4985-a958-2c391f09b88e service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:49.301060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 607/1210] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:31:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:31:51.872054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:51.872610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:51.872610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:51.874413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 604/1211] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:31:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:51.880631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f177b-9a12-4f8d-bc03-b50251983189 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:51.881088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f177b-9a12-4f8d-bc03-b50251983189 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:51.881368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f177b-9a12-4f8d-bc03-b50251983189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:51.947538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-734f177b-9a12-4f8d-bc03-b50251983189 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:51.948738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-734f177b-9a12-4f8d-bc03-b50251983189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:52.044299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 608/1212] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:31:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:52.085852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:52.087520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:52.195469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2de3f5-c4d9-43e7-b5dd-409412b5f5bd None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:52.268337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:52.268993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:52.269280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:52.269557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:52.271947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:52.383202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:52.384656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e2828-6187-4237-b1f4-7c719a722a47 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:52.402814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 605/1213] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:31:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:31:55.062829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:55.063402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:55.063402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:55.065175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 609/1214] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:55.071579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:55.071988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:55.072205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:55.145798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:55.147053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:55.247374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 606/1215] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:55.282854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:55.284383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:55.408331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0d76-12d4-4267-9867-701e15adf614 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:55.498937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:55.499816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:55.500096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:55.500369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:55.510475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:55.512727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732456a-c7e7-4af9-b4ff-ef34b2a151c5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:55.514570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 610/1216] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:31:55 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:31:55.527931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:55.529129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:55.620135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ec2a9-e8bb-4fcd-87ae-5192e42c0428 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:55.691414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:55.692248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:55.692487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:55.692770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:55.694424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:55.803428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:55.804900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dea1b4-85c9-4c2b-9b19-7ccbf85e3abf service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:55.823893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 607/1217] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:31:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:31:58.711002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:58.711571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:58.711571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:58.713455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 611/1218] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:31:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:58.719993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89f8c-84fb-4649-91e3-bf53ed1eadca None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:58.720524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89f8c-84fb-4649-91e3-bf53ed1eadca None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:58.720626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89f8c-84fb-4649-91e3-bf53ed1eadca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:58.784656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cdf89f8c-84fb-4649-91e3-bf53ed1eadca None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:58.786664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cdf89f8c-84fb-4649-91e3-bf53ed1eadca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:58.884860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 608/1219] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:31:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:31:58.920622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:58.922155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:59.048805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ce73d-8914-4a0c-b0e8-30966e092485 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:59.140667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:59.141522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:59.141800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:59.142071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:59.152289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:59.154348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fec5f-eb5a-4a59-88fb-c4d5644b85d5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:59.156070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 612/1220] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:31:58 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:31:59.184773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:59.185065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:59.185347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:59.187188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 609/1221] 10.222.0.76 () {54 vars in 964 bytes} [Thu Oct 28 08:31:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:31:59.194511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fde6-4869-4c3f-93bc-f1e83be28621 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:59.194820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fde6-4869-4c3f-93bc-f1e83be28621 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:59.195103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fde6-4869-4c3f-93bc-f1e83be28621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:59.268289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-38a0fde6-4869-4c3f-93bc-f1e83be28621 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:31:59.269488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-38a0fde6-4869-4c3f-93bc-f1e83be28621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:59.342020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 613/1222] 10.222.0.76 () {58 vars in 1061 bytes} [Thu Oct 28 08:31:59 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:31:59.352000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:31:59.353548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:59.453997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14911d73-d643-479c-9aa9-5fc21dd3a0b5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:31:59.525526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:31:59.526180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:31:59.526463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:31:59.526765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:31:59.528394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:31:59.632526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:31:59.633876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94b719-d464-405e-8ff7-e8749818bd86 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:31:59.651220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 610/1223] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:31:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:03.126798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:03.127337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:03.127337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:03.129553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 614/1224] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:03.136215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe0c7-c07e-4764-a0bd-878946a44a33 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:03.136737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe0c7-c07e-4764-a0bd-878946a44a33 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:03.136830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fe0c7-c07e-4764-a0bd-878946a44a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:03.205127 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d53fe0c7-c07e-4764-a0bd-878946a44a33 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:03.206371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d53fe0c7-c07e-4764-a0bd-878946a44a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:03.307093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 611/1225] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:03.345869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:03.347442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:03.451818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab174531-a718-43d2-b98a-7896f07b9296 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:03.525687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:03.526338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:03.526660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:03.526945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:03.528580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:03.635997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:03.637363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffc171-f3f5-4eda-a97b-1200d62eeb9d service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:03.656254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 615/1226] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:06.002934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:06.003477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:06.003477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:06.006408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 612/1227] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:06.012592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a75ca-4355-4299-b9a6-f4cf261694df None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:06.013072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a75ca-4355-4299-b9a6-f4cf261694df None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:06.013167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a75ca-4355-4299-b9a6-f4cf261694df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:06.082381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-897a75ca-4355-4299-b9a6-f4cf261694df None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:06.083766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-897a75ca-4355-4299-b9a6-f4cf261694df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:06.179145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 616/1228] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:06.218045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:06.219687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:06.324924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326eb57-397c-451a-9598-2f9b1c9c30fd None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:06.405156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:06.406082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:06.406365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:06.406682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:06.408324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:06.514166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:06.515650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0c760-c8bf-4521-9ccb-b7d069c34cc9 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:06.533667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 613/1229] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:08.886326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:08.886907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:08.886907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:08.888805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 617/1230] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:08.897542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:08.898139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:08.898139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:08.965621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:08.966845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:09.067147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 614/1231] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:09.098960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:09.100515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:09.223945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31be63e-7553-4a7e-b2b9-8ef0c908be1a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:09.326683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:09.327467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:09.327745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:09.328018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:09.337863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:09.339987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5cc2e-5781-4e0c-af35-eaf74e268c36 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:09.341738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 618/1232] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:32:09 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:32:09.354656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:09.356234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:09.449846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089efb7-c74f-4a57-98c7-cfb4833fbb3d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:09.522894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:09.523552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:09.523836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:09.524115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:09.525737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:09.631331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:09.632696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e0715-952f-440c-a7f1-4caa3a61d35e service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:09.650838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 615/1233] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:12.201734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:12.202291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:12.202291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:12.204096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 619/1234] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:12.210602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d71f-8072-4e90-b61c-da1ff05a16e7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:12.211058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d71f-8072-4e90-b61c-da1ff05a16e7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:12.211201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d71f-8072-4e90-b61c-da1ff05a16e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:12.275854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8be8d71f-8072-4e90-b61c-da1ff05a16e7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:12.276989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8be8d71f-8072-4e90-b61c-da1ff05a16e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:12.372647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 616/1235] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:12.411433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:12.412975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:12.514116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94111b7-9171-45ce-aa3b-7f7c6be9843c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:12.584409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:12.585088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:12.585344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:12.585620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:12.587310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:12.692373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:12.693811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1d625-2bdd-40b4-94d4-bc7fc72c46b8 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:12.712108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 620/1236] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:15.049815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:15.050923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:15.051451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:15.052762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 617/1237] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:15.060022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6393-706f-4ebf-8f0d-4e49532e4c88 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:15.060528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6393-706f-4ebf-8f0d-4e49532e4c88 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:15.060629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6393-706f-4ebf-8f0d-4e49532e4c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:15.128004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bf7e6393-706f-4ebf-8f0d-4e49532e4c88 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:15.130290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bf7e6393-706f-4ebf-8f0d-4e49532e4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:15.226515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 621/1238] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:32:15.270357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:15.271930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:15.371684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186071-9b1d-4c5d-a8f3-bcf14d4fc355 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:15.442361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:15.443110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:15.443399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:15.443671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:15.445304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:15.552624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:15.554069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d169781-06bc-451b-9311-e1e3c8448924 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:15.571703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 618/1239] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:32:18.167898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:18.168420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:18.168534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:18.170380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 622/1240] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:18.177227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c245-12d1-4e6a-8622-1cbd1a7bb6a0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:18.177692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c245-12d1-4e6a-8622-1cbd1a7bb6a0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:18.177874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1c245-12d1-4e6a-8622-1cbd1a7bb6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:18.247197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6bf1c245-12d1-4e6a-8622-1cbd1a7bb6a0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:18.248474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6bf1c245-12d1-4e6a-8622-1cbd1a7bb6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:18.353098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 619/1241] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:18.390925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:18.393094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:18.502238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf98d9a-ecf8-4ba9-b364-b85df9dbafe4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:18.506709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:18.507355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:18.507643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:18.507922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:18.516715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:18.518159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174c192-af98-42b3-babd-1483ecf02a40 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:18.528082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 623/1242] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:22.835347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:22.835865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:22.835865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:22.837736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 620/1243] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:22.843830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9adf-2cf2-4f0a-9d14-89875921196e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:22.844285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9adf-2cf2-4f0a-9d14-89875921196e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:22.844382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9adf-2cf2-4f0a-9d14-89875921196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:22.866065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-476c9adf-2cf2-4f0a-9d14-89875921196e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:22.867302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-476c9adf-2cf2-4f0a-9d14-89875921196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:22.875143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 624/1244] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:22.916702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:22.918457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:22.932668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1910d-a3b9-4d8c-840f-9673367ebba8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:22.936199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:22.936933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:22.937224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:22.937500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:22.947249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:22.948687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157900e4-d325-4a5b-8ec8-3a83810365bd service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:22.958414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 621/1245] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:25.940276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2840-8c61-456e-b73c-5e87319b81cd None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:25.941012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2840-8c61-456e-b73c-5e87319b81cd None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:25.941012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e2840-8c61-456e-b73c-5e87319b81cd None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:25.947074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 625/1246] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:32:25.949102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2fd9-08d9-4362-9de2-7ff510d34d4b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:25.949547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2fd9-08d9-4362-9de2-7ff510d34d4b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:25.949666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2fd9-08d9-4362-9de2-7ff510d34d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:25.967677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-689a2fd9-08d9-4362-9de2-7ff510d34d4b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:25.968911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-689a2fd9-08d9-4362-9de2-7ff510d34d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:25.977652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 622/1247] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:26.017791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e2840-8c61-456e-b73c-5e87319b81cd None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:26.029070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e2840-8c61-456e-b73c-5e87319b81cd None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:26.032908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:26.033562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:26.033971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:26.034801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:26.049468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:26.051760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645826c8-8d56-4701-b30f-218f07f2ed89 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:26.061851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 626/1248] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:32:30.629527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b68be-a409-4e1d-849e-6df83b522b2e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:30.630110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b68be-a409-4e1d-849e-6df83b522b2e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:30.630110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b68be-a409-4e1d-849e-6df83b522b2e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:30.631913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 623/1249] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:30.638402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80bde-50c2-4489-b854-ad1ad9ee8935 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:30.638902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80bde-50c2-4489-b854-ad1ad9ee8935 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:30.639145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a80bde-50c2-4489-b854-ad1ad9ee8935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:30.656987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-05a80bde-50c2-4489-b854-ad1ad9ee8935 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:30.658115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-05a80bde-50c2-4489-b854-ad1ad9ee8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:30.667004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 627/1250] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:30.709299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b68be-a409-4e1d-849e-6df83b522b2e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:30.719665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b68be-a409-4e1d-849e-6df83b522b2e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:30.723929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:30.724575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:30.724863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:30.725139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:30.734541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:30.735990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099869d-7049-4821-ab30-c781dab02e38 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:30.745704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 624/1251] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:35.995769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e200-d6ff-45da-a3fb-a7605438c6b1 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:35.996300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e200-d6ff-45da-a3fb-a7605438c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:35.996382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e200-d6ff-45da-a3fb-a7605438c6b1 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:36.003334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 628/1252] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:32:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:36.005851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bbe0-3363-4829-a682-c6bf5894dd07 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:36.006907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bbe0-3363-4829-a682-c6bf5894dd07 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:36.007404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7bbe0-3363-4829-a682-c6bf5894dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:36.102555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-55c7bbe0-3363-4829-a682-c6bf5894dd07 None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:36.104417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-55c7bbe0-3363-4829-a682-c6bf5894dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:36.200153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 625/1253] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:32:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:40.856424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490260-828c-41f0-8cb3-a76c88cd5cf0 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:40.857588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490260-828c-41f0-8cb3-a76c88cd5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:40.858479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490260-828c-41f0-8cb3-a76c88cd5cf0 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:40.860917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 629/1254] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:32:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:40.867051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659b2c-2ff9-4b56-b2ce-12e9db028bfb None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:40.867654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659b2c-2ff9-4b56-b2ce-12e9db028bfb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:40.867654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659b2c-2ff9-4b56-b2ce-12e9db028bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:40.888525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4d659b2c-2ff9-4b56-b2ce-12e9db028bfb None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:40.889759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4d659b2c-2ff9-4b56-b2ce-12e9db028bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:40.900005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 626/1255] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:32:40 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:42.193384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f85e9-6046-4f5c-831f-24547db1364e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:42.194123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f85e9-6046-4f5c-831f-24547db1364e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:42.194123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f85e9-6046-4f5c-831f-24547db1364e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:42.196318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 630/1256] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:32:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:42.202530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ceae-f0f3-4a6c-a5b0-b623bfc7e940 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:42.203068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ceae-f0f3-4a6c-a5b0-b623bfc7e940 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:42.203168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121ceae-f0f3-4a6c-a5b0-b623bfc7e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:42.223151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d121ceae-f0f3-4a6c-a5b0-b623bfc7e940 None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:42.224416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d121ceae-f0f3-4a6c-a5b0-b623bfc7e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:42.233951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 627/1257] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:32:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:46.124069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f2c2-183a-4b89-acfb-955dd090aefa None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:46.124578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f2c2-183a-4b89-acfb-955dd090aefa None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:46.124657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085f2c2-183a-4b89-acfb-955dd090aefa None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:46.126554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 631/1258] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:46.133669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbfa97-bb9c-4d5b-a612-70f3c1b7688f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:46.134117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbfa97-bb9c-4d5b-a612-70f3c1b7688f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:46.134204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbfa97-bb9c-4d5b-a612-70f3c1b7688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:46.152619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e0cbfa97-bb9c-4d5b-a612-70f3c1b7688f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:46.153793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e0cbfa97-bb9c-4d5b-a612-70f3c1b7688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:46.162427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 628/1259] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:46.215690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2982-acf4-451c-82c2-4884e1175a00 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:46.216053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2982-acf4-451c-82c2-4884e1175a00 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:46.216570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2982-acf4-451c-82c2-4884e1175a00 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:46.218415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 632/1260] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:32:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:46.225009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475bce-8219-42c5-93bc-ed2bcab760a8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:46.225288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475bce-8219-42c5-93bc-ed2bcab760a8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:46.225731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea475bce-8219-42c5-93bc-ed2bcab760a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:46.281813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ea475bce-8219-42c5-93bc-ed2bcab760a8 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:46.283219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ea475bce-8219-42c5-93bc-ed2bcab760a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:46.370662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 629/1261] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:32:46 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:32:46.380370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2982-acf4-451c-82c2-4884e1175a00 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:46.397152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2982-acf4-451c-82c2-4884e1175a00 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:46.402484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:46.403144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:46.403435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:46.403815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:46.413107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:46.414886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc147be-2cce-46c2-bd79-f4e88d48bf28 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:46.425325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 633/1262] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:32:48.944089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7925-511b-4bbd-a41a-ad0f8084826e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:48.944601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7925-511b-4bbd-a41a-ad0f8084826e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:48.944969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb7925-511b-4bbd-a41a-ad0f8084826e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:48.947158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 630/1263] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:48.953133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f7d-947f-41f1-a769-3d03e2732c93 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:48.953533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f7d-947f-41f1-a769-3d03e2732c93 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:48.953688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b9f7d-947f-41f1-a769-3d03e2732c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:48.972877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6d8b9f7d-947f-41f1-a769-3d03e2732c93 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:48.974077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6d8b9f7d-947f-41f1-a769-3d03e2732c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:48.982570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 634/1264] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:49.031596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb7925-511b-4bbd-a41a-ad0f8084826e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:49.046909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb7925-511b-4bbd-a41a-ad0f8084826e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:49.052729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:49.053480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:49.053867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:49.054241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:49.062813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:49.065193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3ec41-4b63-4506-87cf-a0e3a5f79b1d service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:49.075279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 631/1265] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:51.772959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfc99-e61c-4c38-843d-01c1c9ba2878 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:51.773463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfc99-e61c-4c38-843d-01c1c9ba2878 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:51.773463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbfc99-e61c-4c38-843d-01c1c9ba2878 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:51.775457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 635/1266] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:51.781870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e6fc-87eb-434e-b5b6-1356b6c19398 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:51.782776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e6fc-87eb-434e-b5b6-1356b6c19398 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:51.783902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e6fc-87eb-434e-b5b6-1356b6c19398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:51.802206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-bff7e6fc-87eb-434e-b5b6-1356b6c19398 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:51.803542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bff7e6fc-87eb-434e-b5b6-1356b6c19398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:51.812653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 632/1267] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:51.865458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448e8e-8966-44b6-8571-20a554333979 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:51.866079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448e8e-8966-44b6-8571-20a554333979 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:51.866602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c448e8e-8966-44b6-8571-20a554333979 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:51.869676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 636/1268] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:32:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:51.876731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdd4e-54b5-4a8c-9423-6fadd8124c35 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:51.877015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdd4e-54b5-4a8c-9423-6fadd8124c35 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:51.877280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdd4e-54b5-4a8c-9423-6fadd8124c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:51.897945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3cafdd4e-54b5-4a8c-9423-6fadd8124c35 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:51.899600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3cafdd4e-54b5-4a8c-9423-6fadd8124c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:51.910358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 633/1269] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:32:51 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:51.918723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448e8e-8966-44b6-8571-20a554333979 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:51.935204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c448e8e-8966-44b6-8571-20a554333979 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:51.941873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:51.942792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:51.943231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:51.943707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:51.953720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:51.956151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36879dc7-34ae-4cae-9f43-008e71787bdf service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:51.967639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 637/1270] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:32:54.051888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb727ea-4f70-44f2-ac72-da7b24ac9927 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.052456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb727ea-4f70-44f2-ac72-da7b24ac9927 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.052456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb727ea-4f70-44f2-ac72-da7b24ac9927 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.054215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 634/1271] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:54.060365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc935c7-1af3-4d04-9b31-f9e4e022e46b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.060815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc935c7-1af3-4d04-9b31-f9e4e022e46b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.060929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc935c7-1af3-4d04-9b31-f9e4e022e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.079827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4fc935c7-1af3-4d04-9b31-f9e4e022e46b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:54.081283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4fc935c7-1af3-4d04-9b31-f9e4e022e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:54.094533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 638/1272] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:54.145085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ada1-a14f-4a8c-ac10-b24587345b37 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.145368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ada1-a14f-4a8c-ac10-b24587345b37 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.145896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132ada1-a14f-4a8c-ac10-b24587345b37 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.147923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 635/1273] 10.222.0.76 () {54 vars in 962 bytes} [Thu Oct 28 08:32:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:54.153631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029953f-cfbc-4cf1-a3f5-092d840299de None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.153926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029953f-cfbc-4cf1-a3f5-092d840299de None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.154203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029953f-cfbc-4cf1-a3f5-092d840299de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.209931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-9029953f-cfbc-4cf1-a3f5-092d840299de None None] MFA Rules not processed for user `64c05096a69740909d10c748be820840`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:54.211281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9029953f-cfbc-4cf1-a3f5-092d840299de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:54.282366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 639/1274] 10.222.0.76 () {58 vars in 1059 bytes} [Thu Oct 28 08:32:54 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:54.290943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ada1-a14f-4a8c-ac10-b24587345b37 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:54.302832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132ada1-a14f-4a8c-ac10-b24587345b37 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:54.306356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:54.307105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.307483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.307934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.318456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:54.320311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a056736-a168-44da-beee-e8699d39181d service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:54.333126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 636/1275] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:54.354548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e54c-3d38-469d-88d1-9d47dd8f53fe None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.354982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e54c-3d38-469d-88d1-9d47dd8f53fe None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.355339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e54c-3d38-469d-88d1-9d47dd8f53fe None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.358058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 640/1276] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:54.367459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8898-ba6f-43d0-b007-e84a38580836 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.367459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8898-ba6f-43d0-b007-e84a38580836 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.367459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8898-ba6f-43d0-b007-e84a38580836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.386327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-38db8898-ba6f-43d0-b007-e84a38580836 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:54.387655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-38db8898-ba6f-43d0-b007-e84a38580836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:54.399084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 637/1277] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:54.448854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e54c-3d38-469d-88d1-9d47dd8f53fe None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:54.463990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e54c-3d38-469d-88d1-9d47dd8f53fe None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:54.469712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:54.470877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:54.471333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:54.471474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:54.480189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:54.481795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98cfd1-3ae4-470d-8fe8-0a962df5ef80 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:54.492392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 641/1278] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:32:56.870742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ad64-6a11-40f3-bf5f-8f145a432206 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:56.871553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ad64-6a11-40f3-bf5f-8f145a432206 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:56.871553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ad64-6a11-40f3-bf5f-8f145a432206 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:56.873101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 638/1279] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:56.880127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cba60-b001-4fc8-ab89-3b15f9ddbd2b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:56.880800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cba60-b001-4fc8-ab89-3b15f9ddbd2b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:56.880800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cba60-b001-4fc8-ab89-3b15f9ddbd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:56.898921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e30cba60-b001-4fc8-ab89-3b15f9ddbd2b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:56.900126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e30cba60-b001-4fc8-ab89-3b15f9ddbd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:56.908775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 642/1280] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:32:56.964431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ad64-6a11-40f3-bf5f-8f145a432206 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:56.979902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ad64-6a11-40f3-bf5f-8f145a432206 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:56.985477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:56.986308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:56.986620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:56.986902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:56.995713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:56.997309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a910789-0668-4995-996c-f30e3bfa585f service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:57.007200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 639/1281] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:32:59.432290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec96cf-3992-4c53-942b-69108b526127 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:59.433264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec96cf-3992-4c53-942b-69108b526127 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:59.433689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec96cf-3992-4c53-942b-69108b526127 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:59.435890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 643/1282] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:32:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:32:59.443723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4f8b-1e06-4731-b590-84db7d4ee203 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:59.444295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4f8b-1e06-4731-b590-84db7d4ee203 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:59.444534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4f8b-1e06-4731-b590-84db7d4ee203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:59.463381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c89a4f8b-1e06-4731-b590-84db7d4ee203 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:32:59.464750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c89a4f8b-1e06-4731-b590-84db7d4ee203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:32:59.473511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 640/1283] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:32:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:32:59.523464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec96cf-3992-4c53-942b-69108b526127 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:32:59.540686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec96cf-3992-4c53-942b-69108b526127 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:32:59.546713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:32:59.547370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:32:59.547663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:32:59.547935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:32:59.557958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:32:59.559704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9ebdf-98fa-48c8-8eae-2fcc5c807e1d service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:32:59.571528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 644/1284] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:32:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:02.023876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb295e4-bf27-4345-a65d-4cdcc4a18c8a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:02.024594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb295e4-bf27-4345-a65d-4cdcc4a18c8a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:02.024594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb295e4-bf27-4345-a65d-4cdcc4a18c8a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:02.026147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 641/1285] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:33:02.034965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026bc0-4075-4935-bfa5-b19c55dc8a45 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:02.035468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026bc0-4075-4935-bfa5-b19c55dc8a45 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:02.035702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026bc0-4075-4935-bfa5-b19c55dc8a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:02.060186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0d026bc0-4075-4935-bfa5-b19c55dc8a45 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:02.062401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0d026bc0-4075-4935-bfa5-b19c55dc8a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:02.073888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 645/1286] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:02.120838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb295e4-bf27-4345-a65d-4cdcc4a18c8a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:02.135341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb295e4-bf27-4345-a65d-4cdcc4a18c8a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:02.140871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:02.141512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:02.141798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:02.142308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:02.150683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:02.152288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8181c14-a164-44d7-ade8-2c1b98742792 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:02.162650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 642/1287] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:04.547516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbeca-bc64-4c90-9c64-02b53a63b679 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:04.548555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbeca-bc64-4c90-9c64-02b53a63b679 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:04.548555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cbeca-bc64-4c90-9c64-02b53a63b679 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:04.550453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 646/1288] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:04.556646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49fe4b-4eeb-4501-8c7f-f2dd6a9ec9d2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:04.557186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49fe4b-4eeb-4501-8c7f-f2dd6a9ec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:04.557186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49fe4b-4eeb-4501-8c7f-f2dd6a9ec9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:04.576008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7e49fe4b-4eeb-4501-8c7f-f2dd6a9ec9d2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:04.577363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7e49fe4b-4eeb-4501-8c7f-f2dd6a9ec9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:04.586467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 643/1289] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:04.634563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbeca-bc64-4c90-9c64-02b53a63b679 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:04.653983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cbeca-bc64-4c90-9c64-02b53a63b679 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:04.662529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:04.663384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:04.663739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:04.664074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:04.674958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:04.676663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a46ab3-a857-4923-b36b-cd4e0c4d13c4 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:04.686627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 647/1290] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:07.046971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b311-7f3a-4913-a403-336800b2482c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:07.047517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b311-7f3a-4913-a403-336800b2482c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:07.047673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442b311-7f3a-4913-a403-336800b2482c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:07.050323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 644/1291] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:07.057997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc761e-2f6d-4da9-aa13-cce05e3d7371 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:07.058749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc761e-2f6d-4da9-aa13-cce05e3d7371 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:07.058749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc761e-2f6d-4da9-aa13-cce05e3d7371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:07.078607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f6fc761e-2f6d-4da9-aa13-cce05e3d7371 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:07.080579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f6fc761e-2f6d-4da9-aa13-cce05e3d7371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:07.091669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 648/1292] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:33:07.143048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b311-7f3a-4913-a403-336800b2482c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:07.161182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442b311-7f3a-4913-a403-336800b2482c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:07.166901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:07.167554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:07.167843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:07.168109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:07.179180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:07.180757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3194ff5-f294-4896-a750-41ad5bde302e service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:07.191665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 645/1293] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:33:09.550747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469e05-a702-4588-aed9-e638feea3c16 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:09.551381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469e05-a702-4588-aed9-e638feea3c16 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:09.551381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469e05-a702-4588-aed9-e638feea3c16 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:09.553101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 649/1294] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:09.559792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162aeee-df37-4d4d-93b2-daff1df9c43b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:09.560367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162aeee-df37-4d4d-93b2-daff1df9c43b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:09.560367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162aeee-df37-4d4d-93b2-daff1df9c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:09.582246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7162aeee-df37-4d4d-93b2-daff1df9c43b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:09.583499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7162aeee-df37-4d4d-93b2-daff1df9c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:09.591776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 646/1295] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:09.640386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469e05-a702-4588-aed9-e638feea3c16 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:09.656486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469e05-a702-4588-aed9-e638feea3c16 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:09.663474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:09.664264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:09.664723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:09.665101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:09.674861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:09.676475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec0d23-3938-4c5f-8db5-05f03129c8d9 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:09.686841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 650/1296] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:09.891965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806af08-2b45-4ee0-9ef7-3c38816c1e3b None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:09.892424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806af08-2b45-4ee0-9ef7-3c38816c1e3b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:09.892783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806af08-2b45-4ee0-9ef7-3c38816c1e3b None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:09.894683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 647/1297] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:09.902889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512470fb-65e2-4e26-868c-7eea402fdd7e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:09.903303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512470fb-65e2-4e26-868c-7eea402fdd7e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:09.903653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512470fb-65e2-4e26-868c-7eea402fdd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:09.931925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-512470fb-65e2-4e26-868c-7eea402fdd7e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:09.933204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-512470fb-65e2-4e26-868c-7eea402fdd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:09.942138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 651/1298] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:10.005349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217998a-1e33-40d9-a04e-9260e3d61c4c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.005634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217998a-1e33-40d9-a04e-9260e3d61c4c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.005914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217998a-1e33-40d9-a04e-9260e3d61c4c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.007838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 648/1299] 10.222.0.76 () {54 vars in 962 bytes} [Thu Oct 28 08:33:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:10.014989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba923-5709-44c3-a1c5-7661b02f524b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.015291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba923-5709-44c3-a1c5-7661b02f524b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.015853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fba923-5709-44c3-a1c5-7661b02f524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.076539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d5fba923-5709-44c3-a1c5-7661b02f524b None None] MFA Rules not processed for user `97167b82c21643c08543bf5d6323c599`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:10.077763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d5fba923-5709-44c3-a1c5-7661b02f524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:10.140961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 652/1300] 10.222.0.76 () {58 vars in 1059 bytes} [Thu Oct 28 08:33:10 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:10.149841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217998a-1e33-40d9-a04e-9260e3d61c4c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:10.162273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217998a-1e33-40d9-a04e-9260e3d61c4c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:10.165950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:10.166640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.166921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.167203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.177640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:10.179185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7352fff-a8ea-4355-bf33-6a6abcd27eee service glance] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:10.190647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 649/1301] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:10.717586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649777-aca0-46c4-8991-7e44dad42e23 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.718140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649777-aca0-46c4-8991-7e44dad42e23 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.718140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85649777-aca0-46c4-8991-7e44dad42e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.785334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-85649777-aca0-46c4-8991-7e44dad42e23 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:10.786594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-85649777-aca0-46c4-8991-7e44dad42e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:10.863969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 653/1302] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:33:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:10.926150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7ee4-c18d-497d-9cfa-972d940762bd None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.926894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7ee4-c18d-497d-9cfa-972d940762bd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.927200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e7ee4-c18d-497d-9cfa-972d940762bd None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.930898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 650/1303] 10.222.0.76 () {54 vars in 942 bytes} [Thu Oct 28 08:33:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:10.939226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecbdd-b238-4a59-a66b-82175aaacc4a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:10.939481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecbdd-b238-4a59-a66b-82175aaacc4a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:10.939765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ecbdd-b238-4a59-a66b-82175aaacc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:10.999486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6a8ecbdd-b238-4a59-a66b-82175aaacc4a None None] MFA Rules not processed for user `18cea006ecc24067ac542e3944ad7a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:11.000652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6a8ecbdd-b238-4a59-a66b-82175aaacc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:11.082522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 654/1304] 10.222.0.76 () {58 vars in 1039 bytes} [Thu Oct 28 08:33:10 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:11.095513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e7ee4-c18d-497d-9cfa-972d940762bd None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:11.112468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e7ee4-c18d-497d-9cfa-972d940762bd None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:11.117651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:11.118653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:11.118653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:11.118873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:11.128482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:11.130590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5d9fd-c9e9-4714-ab56-1478cb300a8e service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:11.139300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 651/1305] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:33:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:33:12.184377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06a4e-db98-4c02-a58c-9089e677ce4d None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:12.184902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06a4e-db98-4c02-a58c-9089e677ce4d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:12.184902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06a4e-db98-4c02-a58c-9089e677ce4d None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:12.186917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 655/1306] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:12.193941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc788-45d2-4ef6-b0a5-cabe055f6c33 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:12.194951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc788-45d2-4ef6-b0a5-cabe055f6c33 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:12.195451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc788-45d2-4ef6-b0a5-cabe055f6c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:12.218427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-dd0bc788-45d2-4ef6-b0a5-cabe055f6c33 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:12.220561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dd0bc788-45d2-4ef6-b0a5-cabe055f6c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:12.234546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 652/1307] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:12.286007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06a4e-db98-4c02-a58c-9089e677ce4d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:12.301356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06a4e-db98-4c02-a58c-9089e677ce4d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:12.306950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:12.307676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:12.308028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:12.308372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:12.321084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:12.321084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7054c-2835-4503-ad90-9b8c50dacd24 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:12.334422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 656/1308] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:14.772350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fde980-2e99-4308-8b81-d7af9ceb73ef None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:14.772904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fde980-2e99-4308-8b81-d7af9ceb73ef None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:14.772904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fde980-2e99-4308-8b81-d7af9ceb73ef None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:14.774745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 653/1309] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:14.783363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f36-7db1-49bd-a3df-97e3e89fe068 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:14.783914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f36-7db1-49bd-a3df-97e3e89fe068 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:14.784132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d50f36-7db1-49bd-a3df-97e3e89fe068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:14.805099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-08d50f36-7db1-49bd-a3df-97e3e89fe068 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:14.806718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-08d50f36-7db1-49bd-a3df-97e3e89fe068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:14.816337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 657/1310] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:14.877771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fde980-2e99-4308-8b81-d7af9ceb73ef None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:14.931563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fde980-2e99-4308-8b81-d7af9ceb73ef None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:14.956027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:14.959205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:14.962953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:14.962953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:14.994911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:14.996541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc314ce-6f11-4700-896a-3d594cc381b2 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:15.008065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 654/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:29.203307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f66c3-77a0-464c-999c-4789ffe65dec None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:29.203972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f66c3-77a0-464c-999c-4789ffe65dec None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:29.204152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f66c3-77a0-464c-999c-4789ffe65dec None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:29.206001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 658/1312] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:29.212108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3667-32e4-4b43-8809-f414a4598dcb None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:29.212578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3667-32e4-4b43-8809-f414a4598dcb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:29.212683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3667-32e4-4b43-8809-f414a4598dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:29.230589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-27ae3667-32e4-4b43-8809-f414a4598dcb None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:29.231792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-27ae3667-32e4-4b43-8809-f414a4598dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:29.240512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 655/1313] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:29.266365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f66c3-77a0-464c-999c-4789ffe65dec None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:29.278913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f66c3-77a0-464c-999c-4789ffe65dec None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:29.283544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:29.284194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:29.284477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:29.284755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:29.285510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:29.287454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d0853-cf4c-4feb-a4d3-6fda22dbb075 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:29.306973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 659/1314] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:33:29 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:33:31.556237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe6cc-10d1-4f18-ae04-3621bdfbbb5c None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:31.556798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe6cc-10d1-4f18-ae04-3621bdfbbb5c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:31.556798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fe6cc-10d1-4f18-ae04-3621bdfbbb5c None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:31.558569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 656/1315] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:33:31.565343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:31.566030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:31.566280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:31.585431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:31.586661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:31.594377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 660/1316] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:31.618754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe6cc-10d1-4f18-ae04-3621bdfbbb5c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:31.631978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fe6cc-10d1-4f18-ae04-3621bdfbbb5c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:31.636401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:31.637237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:31.637515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:31.637783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] PATH_INFO: `/v3/projects/1e14d94113364c66a02c356044e7facf` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:31.648894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e14d94113364c66a02c356044e7facf)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:31.650957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:31.652692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 657/1317] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:31 2021] GET /identity/v3/projects/1e14d94113364c66a02c356044e7facf => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:31.659532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:31.668716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602f18-d811-458b-a56b-9946018698e5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:31.673961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:31.674632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:31.674952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:31.675262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:31.676008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] RBAC: Adding query filter params (scope.project.id=1e14d94113364c66a02c356044e7facf) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:31.676305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:31.678203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278da63a-6b75-48d5-9393-3a7cad929ed9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:31.684580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 661/1318] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:31 2021] GET /identity/v3/role_assignments?scope.project.id=1e14d94113364c66a02c356044e7facf => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:31.691541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:31.701313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb4ec4-12d4-46e0-b99a-7d487cc8c570 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:31.705957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:31.706895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:31.707244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:31.707584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] PATH_INFO: `/v3/users/4ebcff6e33c9428296fb7bb2ea52850f` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:31.720944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=4ebcff6e33c9428296fb7bb2ea52850f)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:31.723119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372749d-edaf-4ece-bca9-8df187ac72c1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:31.724773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 658/1319] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:31 2021] GET /identity/v3/users/4ebcff6e33c9428296fb7bb2ea52850f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:34.026671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934e67-a93b-488e-96c0-c4049f9a10df None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.027238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934e67-a93b-488e-96c0-c4049f9a10df None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.027238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee934e67-a93b-488e-96c0-c4049f9a10df None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.029287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 662/1320] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:34.035924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.036424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.036532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.054117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:34.055370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:34.064061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 659/1321] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:34.088337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934e67-a93b-488e-96c0-c4049f9a10df None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:34.100757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee934e67-a93b-488e-96c0-c4049f9a10df None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:34.105593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:34.106430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.106745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.107024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] PATH_INFO: `/v3/projects/233a02c8450f4e4594eb66d8b3cf1517` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.117973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] RBAC: Authorizing `identity:get_project(project_id=233a02c8450f4e4594eb66d8b3cf1517)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:34.120086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:34.121792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 663/1322] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:34 2021] GET /identity/v3/projects/233a02c8450f4e4594eb66d8b3cf1517 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:34.129546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:34.138519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741db368-a153-48c1-8d5e-cbbb27620a54 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:34.143823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:34.144466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.144750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.145030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.145810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] RBAC: Adding query filter params (scope.project.id=233a02c8450f4e4594eb66d8b3cf1517) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:34.146117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:34.148002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:34.154648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 660/1323] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:34 2021] GET /identity/v3/role_assignments?scope.project.id=233a02c8450f4e4594eb66d8b3cf1517 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:34.161162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:34.170835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea755e-f95e-4552-b141-006acb8ac39d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:34.175861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:34.176706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.176991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.177267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] PATH_INFO: `/v3/users/153fa98f101d4f80852daf5bfd420c84` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.191086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] RBAC: Authorizing `identity:get_user(user_id=153fa98f101d4f80852daf5bfd420c84)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:34.193267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f3a87-8e4f-47fb-b477-ed625ae5cccf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:34.194956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 664/1324] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:34 2021] GET /identity/v3/users/153fa98f101d4f80852daf5bfd420c84 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:34.201343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:34.211794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5671e-c759-46e6-a1bc-d9e78421f50a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:34.216307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:34.217154 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:34.217436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:34.217711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] PATH_INFO: `/v3/users/a42b1b81e2ce430ca74c372aba3c62ed` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:34.231760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] RBAC: Authorizing `identity:get_user(user_id=a42b1b81e2ce430ca74c372aba3c62ed)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:34.233913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1d8a5-f2da-41c0-a4e6-b4a0c95214ea admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:34.236117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 661/1325] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:34 2021] GET /identity/v3/users/a42b1b81e2ce430ca74c372aba3c62ed => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:36.590618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07a3-58e5-4abb-91cf-befa8c60428a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.591145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07a3-58e5-4abb-91cf-befa8c60428a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.591263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b07a3-58e5-4abb-91cf-befa8c60428a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.593014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 665/1326] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:36.599980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.600418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.600579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.619130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:36.620351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:36.632780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 662/1327] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:36.656798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b07a3-58e5-4abb-91cf-befa8c60428a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:36.669377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b07a3-58e5-4abb-91cf-befa8c60428a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:36.674704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:36.675541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.675820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.676094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] PATH_INFO: `/v3/projects/32da7e807d8e4ae2b696b96a98712ae1` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.686666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] RBAC: Authorizing `identity:get_project(project_id=32da7e807d8e4ae2b696b96a98712ae1)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:36.688784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:36.690540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 666/1328] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:36 2021] GET /identity/v3/projects/32da7e807d8e4ae2b696b96a98712ae1 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:36.697469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:36.707676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577d8f-49ca-4dcc-a6e1-36bebe6a536b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:36.712377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:36.713028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.713314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.713589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.714372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] RBAC: Adding query filter params (scope.project.id=32da7e807d8e4ae2b696b96a98712ae1) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:36.714713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:36.716591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:36.724374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 663/1329] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:36 2021] GET /identity/v3/role_assignments?scope.project.id=32da7e807d8e4ae2b696b96a98712ae1 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:33:36.731440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:36.741581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0ae2f-1c85-4b86-a122-33153b7e0050 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:36.746254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:36.747149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.747431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.747706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.748910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:36.750985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801214b-0581-44f2-8fae-83b15030dbf0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:36.752636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 667/1330] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:36 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:36.759648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:36.770211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add44d3-fa87-44d2-a942-a477b382c70a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:36.774855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:36.775717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:36.776002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:36.776284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:36.790938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:36.793101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa70f62-5e56-4a22-acd7-3c82e30ea52a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:36.794865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 664/1331] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:36 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:39.169176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d121-2241-4027-a6be-a3074160e2e5 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:39.169760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d121-2241-4027-a6be-a3074160e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:39.169760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055d121-2241-4027-a6be-a3074160e2e5 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:39.171545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 668/1332] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:39.177704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:39.178121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:39.178259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:39.195521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:39.196746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:39.205065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 665/1333] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:39.229502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d121-2241-4027-a6be-a3074160e2e5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:39.242220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055d121-2241-4027-a6be-a3074160e2e5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:39.246700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:39.247524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:39.247797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:39.248069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] PATH_INFO: `/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:39.259576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] RBAC: Authorizing `identity:get_project(project_id=a2b87b47e7da48bdbc1bb23b106eef08)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:39.261670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:39.263451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 669/1334] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:39 2021] GET /identity/v3/projects/a2b87b47e7da48bdbc1bb23b106eef08 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:39.271177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:39.280270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a90c5e-c924-4dc7-add6-177c0256d804 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:39.285701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:39.286348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:39.286667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:39.286942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:39.287713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] RBAC: Adding query filter params (scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:39.288017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:39.289846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2025-305d-409f-9936-0cdf1ae8079a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:39.295386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 666/1335] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:39 2021] GET /identity/v3/role_assignments?scope.project.id=a2b87b47e7da48bdbc1bb23b106eef08 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:39.301848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:39.311587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2a6fb-2e14-4eda-b284-cb470ab333af admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:39.316913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:39.317764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:39.318047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:39.318325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] PATH_INFO: `/v3/users/389066dd705d4fa28396113080ef7aa0` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:39.332489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] RBAC: Authorizing `identity:get_user(user_id=389066dd705d4fa28396113080ef7aa0)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:39.334672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcae0ec-c5ec-4a28-87c4-e5bef70f8545 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:39.336342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 670/1336] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:39 2021] GET /identity/v3/users/389066dd705d4fa28396113080ef7aa0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:41.690820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfd93-f4a9-4623-92de-6c3c168973e1 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:41.691411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfd93-f4a9-4623-92de-6c3c168973e1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:41.691411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccfd93-f4a9-4623-92de-6c3c168973e1 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:41.693232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 667/1337] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:33:41.699669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:41.700229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:41.700229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:41.717848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:41.719241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:41.727097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 671/1338] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:41.752615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfd93-f4a9-4623-92de-6c3c168973e1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:41.764845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccfd93-f4a9-4623-92de-6c3c168973e1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:41.770432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:41.771297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:41.771583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:41.771858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] PATH_INFO: `/v3/projects/b73c91080d2644b3a0a5c1e12cbec585` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:41.783860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b73c91080d2644b3a0a5c1e12cbec585)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:41.785940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:41.787773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 668/1339] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:41 2021] GET /identity/v3/projects/b73c91080d2644b3a0a5c1e12cbec585 => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:41.794609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:41.804182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35bcb0-50f6-48a0-81c8-9caa5580bb6f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:41.809243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:41.809936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:41.810263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:41.810661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:41.811514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] RBAC: Adding query filter params (scope.project.id=b73c91080d2644b3a0a5c1e12cbec585) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:41.811875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:41.814336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c477b4-32f7-427c-9629-79adeecdc1be admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:41.820399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 672/1340] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:41 2021] GET /identity/v3/role_assignments?scope.project.id=b73c91080d2644b3a0a5c1e12cbec585 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:41.826776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:41.837572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bf0fc-4b97-45b2-9214-98f737eab7b1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:41.842645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:41.843527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:41.843836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:41.844500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] PATH_INFO: `/v3/users/9eb93d4513e246d396afad35fa7eff4e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:41.845820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] RBAC: Authorizing `identity:get_user(user_id=9eb93d4513e246d396afad35fa7eff4e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:41.848017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c93d-0d51-4947-8a01-ff5b43ae3e46 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:41.849725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 669/1341] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:41 2021] GET /identity/v3/users/9eb93d4513e246d396afad35fa7eff4e => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:44.232352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c1f-5f42-4f6c-9e76-696e0cc9ac37 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.232870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c1f-5f42-4f6c-9e76-696e0cc9ac37 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.232964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb50c1f-5f42-4f6c-9e76-696e0cc9ac37 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.235439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 673/1342] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:44.241976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.243045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.243045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.267027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:44.268222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:44.276255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 670/1343] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:44.302880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb50c1f-5f42-4f6c-9e76-696e0cc9ac37 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:44.316689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb50c1f-5f42-4f6c-9e76-696e0cc9ac37 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:44.321658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:44.322427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.322745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.323027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] PATH_INFO: `/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.334828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] RBAC: Authorizing `identity:get_project(project_id=cea0ee93171e4ccdb458be8889b4d5e9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:44.336911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:44.338659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 674/1344] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:44 2021] GET /identity/v3/projects/cea0ee93171e4ccdb458be8889b4d5e9 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:44.346588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:44.355873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052b670-39f2-402c-be8b-4e800584daa3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:44.360400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:44.361056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.361337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.361611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.362391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] RBAC: Adding query filter params (scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:44.362732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:44.364619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:44.371816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 671/1345] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:44 2021] GET /identity/v3/role_assignments?scope.project.id=cea0ee93171e4ccdb458be8889b4d5e9 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:33:44.378719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:44.389857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f84a8e-5096-47f2-82eb-f416ce0b3533 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:44.395714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:44.396589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.396877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.397154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] PATH_INFO: `/v3/users/eb5e99f6cf364aaba3294c1205dca73a` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.412537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=eb5e99f6cf364aaba3294c1205dca73a)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:44.414746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175938-748b-481d-a96b-584712dae9f8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:44.416481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 675/1346] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:44 2021] GET /identity/v3/users/eb5e99f6cf364aaba3294c1205dca73a => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:44.423329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:44.433225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a5d68-540d-4f47-8aef-3dfca5b84c30 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:44.438180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:44.439181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:44.439459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:44.439730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:44.440970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:44.442801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6190261-a905-4bd1-a1ff-42c733ea256b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:44.444435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 672/1347] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:44 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:46.834689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0decdcf-dc41-419c-a155-720a63596502 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:46.835280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0decdcf-dc41-419c-a155-720a63596502 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:46.835280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0decdcf-dc41-419c-a155-720a63596502 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:46.837010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 676/1348] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:46.843191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:46.843673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:46.844439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:46.863443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:46.864684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:46.874218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 673/1349] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:46.899989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0decdcf-dc41-419c-a155-720a63596502 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:46.914569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0decdcf-dc41-419c-a155-720a63596502 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:46.919156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:46.920004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:46.920287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:46.920558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] PATH_INFO: `/v3/projects/ff2c85101aec4012bf80ddd35cbbddef` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:46.921763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] RBAC: Authorizing `identity:get_project(project_id=ff2c85101aec4012bf80ddd35cbbddef)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:46.924223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:46.926069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 677/1350] 10.222.0.76 () {56 vars in 1207 bytes} [Thu Oct 28 08:33:46 2021] GET /identity/v3/projects/ff2c85101aec4012bf80ddd35cbbddef => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:46.933329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:46.943609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de46dc-0d53-41f4-9ef6-197ac22d132c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:46.949061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:46.949733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:46.950021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:46.950298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:46.951138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] RBAC: Adding query filter params (scope.project.id=ff2c85101aec4012bf80ddd35cbbddef) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:33:46.951447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:46.953351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172babbd-ed4c-45f8-9b3e-5f9cfaf59bd9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:46.960065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 674/1351] 10.222.0.76 () {56 vars in 1231 bytes} [Thu Oct 28 08:33:46 2021] GET /identity/v3/role_assignments?scope.project.id=ff2c85101aec4012bf80ddd35cbbddef => generated 879 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:46.966795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:46.977971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c3fc9-bbc1-4bc3-b46f-553c9d95841c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:46.983018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:46.983881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:46.984153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:46.984487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] PATH_INFO: `/v3/users/caea61e355e24e9880292252c98a910d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:46.986441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] RBAC: Authorizing `identity:get_user(user_id=caea61e355e24e9880292252c98a910d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:46.988287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5494c-51bf-4c59-836a-de814cb0136e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:46.990186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 678/1352] 10.222.0.76 () {56 vars in 1198 bytes} [Thu Oct 28 08:33:46 2021] GET /identity/v3/users/caea61e355e24e9880292252c98a910d => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:33:52.469990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf3f0-81f8-474a-be31-a897cf7ff588 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:52.470562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf3f0-81f8-474a-be31-a897cf7ff588 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:52.470562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf3f0-81f8-474a-be31-a897cf7ff588 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:52.472285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 675/1353] 10.222.0.76 () {54 vars in 918 bytes} [Thu Oct 28 08:33:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:52.478137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec8cc-ce5f-4783-921b-a72300494bd3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:52.478850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec8cc-ce5f-4783-921b-a72300494bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:52.478985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec8cc-ce5f-4783-921b-a72300494bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:52.497364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0e1ec8cc-ce5f-4783-921b-a72300494bd3 None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:52.498589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0e1ec8cc-ce5f-4783-921b-a72300494bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:52.507790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 679/1354] 10.222.0.76 () {58 vars in 1015 bytes} [Thu Oct 28 08:33:52 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:33:52.523578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fb4dd-7651-434b-812d-7a34df8996cd None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:52.523861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fb4dd-7651-434b-812d-7a34df8996cd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:52.524143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fb4dd-7651-434b-812d-7a34df8996cd None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:52.525948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 676/1355] 10.222.0.76 () {54 vars in 918 bytes} [Thu Oct 28 08:33:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:52.531121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4de5-4609-4104-aaf8-efbfa6ae96f7 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:52.531470 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4de5-4609-4104-aaf8-efbfa6ae96f7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:52.532000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd4de5-4609-4104-aaf8-efbfa6ae96f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:52.549789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cefd4de5-4609-4104-aaf8-efbfa6ae96f7 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:52.551004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cefd4de5-4609-4104-aaf8-efbfa6ae96f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:52.560079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 680/1356] 10.222.0.76 () {58 vars in 1015 bytes} [Thu Oct 28 08:33:52 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:55.557491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a69da-18f1-4ad6-bd53-2c9167f46c28 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:55.558005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a69da-18f1-4ad6-bd53-2c9167f46c28 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:55.558121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a69da-18f1-4ad6-bd53-2c9167f46c28 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:55.559909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 677/1357] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:33:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:55.567044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aafd3-73a7-45e1-9404-3c250d9dc3e6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:55.567479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aafd3-73a7-45e1-9404-3c250d9dc3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:55.567605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902aafd3-73a7-45e1-9404-3c250d9dc3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:55.585476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-902aafd3-73a7-45e1-9404-3c250d9dc3e6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:55.586714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-902aafd3-73a7-45e1-9404-3c250d9dc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:55.594743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 681/1358] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:33:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:33:55.639708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a69da-18f1-4ad6-bd53-2c9167f46c28 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:55.654528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a69da-18f1-4ad6-bd53-2c9167f46c28 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:55.660167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:55.660802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:55.661090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:55.661366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:55.669382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:55.670999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7685f41-db9e-4ed8-b300-1de30f7d429e service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:55.680812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 678/1359] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:57.191058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9830-b2c2-4a23-a323-7a4a7547c86e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:57.191688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9830-b2c2-4a23-a323-7a4a7547c86e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:57.191688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb9830-b2c2-4a23-a323-7a4a7547c86e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:57.193474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 682/1360] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:33:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:57.199721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff610-a00e-4fa9-83ed-963d3664b44b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:57.200206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff610-a00e-4fa9-83ed-963d3664b44b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:57.200311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff610-a00e-4fa9-83ed-963d3664b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:57.218466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cb2ff610-a00e-4fa9-83ed-963d3664b44b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:57.220636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cb2ff610-a00e-4fa9-83ed-963d3664b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:57.228430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 679/1361] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:33:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:57.388767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9830-b2c2-4a23-a323-7a4a7547c86e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:57.403180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb9830-b2c2-4a23-a323-7a4a7547c86e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:57.409159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:57.409785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:57.410064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:57.410335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:57.418790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:57.420423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f976ce-ca38-4e18-b8b5-3273a2d914a0 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:57.430314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 683/1362] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:33:58.916453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12981e2-cc24-4f4d-b2ef-7ec429092224 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:58.917044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12981e2-cc24-4f4d-b2ef-7ec429092224 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:58.917044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12981e2-cc24-4f4d-b2ef-7ec429092224 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:58.918844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 680/1363] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:33:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:33:58.925301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a9ab-bd60-4e8b-99dc-71d93aa00873 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:58.925807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a9ab-bd60-4e8b-99dc-71d93aa00873 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:58.925936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a9ab-bd60-4e8b-99dc-71d93aa00873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:58.943568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2c18a9ab-bd60-4e8b-99dc-71d93aa00873 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:33:58.944788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2c18a9ab-bd60-4e8b-99dc-71d93aa00873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:33:58.952622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 684/1364] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:33:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:33:59.109273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12981e2-cc24-4f4d-b2ef-7ec429092224 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:33:59.124179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12981e2-cc24-4f4d-b2ef-7ec429092224 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:33:59.129562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:33:59.130201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:33:59.130485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:33:59.130798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:33:59.138851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:33:59.140428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674231aa-645f-4b91-95d2-713410547ce3 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:33:59.149714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 681/1365] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:33:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:00.634834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b6c3-d9f3-4ffd-b430-2fbadb45a85a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:00.635434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b6c3-d9f3-4ffd-b430-2fbadb45a85a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:00.635434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0b6c3-d9f3-4ffd-b430-2fbadb45a85a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:00.637163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 685/1366] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:00.642857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c711-b840-486d-99b5-8532b51414cc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:00.643340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c711-b840-486d-99b5-8532b51414cc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:00.643452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c711-b840-486d-99b5-8532b51414cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:00.661783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7b05c711-b840-486d-99b5-8532b51414cc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:00.663035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7b05c711-b840-486d-99b5-8532b51414cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:00.670846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 682/1367] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:34:00.825168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b6c3-d9f3-4ffd-b430-2fbadb45a85a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:00.840757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0b6c3-d9f3-4ffd-b430-2fbadb45a85a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:00.847004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:00.847693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:00.848021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:00.848340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:00.857104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:00.858758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2864e0-d2d6-4541-a9df-e44ad29572e0 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:00.868480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 686/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:02.429260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d028-3a18-40e5-a51b-841b89ef57b8 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:02.429799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d028-3a18-40e5-a51b-841b89ef57b8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:02.429799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476d028-3a18-40e5-a51b-841b89ef57b8 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:02.431584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 683/1369] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:34:02.437127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28598-d020-48d0-98db-a1ba50bac523 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:02.438881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28598-d020-48d0-98db-a1ba50bac523 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:02.438881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28598-d020-48d0-98db-a1ba50bac523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:02.456461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-dea28598-d020-48d0-98db-a1ba50bac523 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:02.457667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dea28598-d020-48d0-98db-a1ba50bac523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:02.465636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 687/1370] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:02.621914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d028-3a18-40e5-a51b-841b89ef57b8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:02.637038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476d028-3a18-40e5-a51b-841b89ef57b8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:02.644434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:02.645128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:02.645411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:02.645690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:02.654165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:02.655794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d537d9f-edfb-477e-8fa1-8acd1e8903bc service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:02.665591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 684/1371] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:04.115775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa625-6333-4e06-b33e-f897c0559f31 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:04.116304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa625-6333-4e06-b33e-f897c0559f31 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:04.116407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1aa625-6333-4e06-b33e-f897c0559f31 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:04.118155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 688/1372] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:04.123892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5ede-877b-40de-8fe5-c885239fc274 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:04.124351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5ede-877b-40de-8fe5-c885239fc274 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:04.124488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5ede-877b-40de-8fe5-c885239fc274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:04.143448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e06b5ede-877b-40de-8fe5-c885239fc274 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:04.144666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e06b5ede-877b-40de-8fe5-c885239fc274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:04.152673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 685/1373] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:04.313975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1aa625-6333-4e06-b33e-f897c0559f31 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:04.329503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1aa625-6333-4e06-b33e-f897c0559f31 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:04.335542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:04.336203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:04.336502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:04.336777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:04.345339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:04.346973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc86-ad84-4034-a4fc-e25d66a45e77 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:04.356939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 689/1374] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:34:05.793521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bdc6d-adfc-40bb-a6a8-5de4bb46bad4 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:05.794055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bdc6d-adfc-40bb-a6a8-5de4bb46bad4 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:05.794055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bdc6d-adfc-40bb-a6a8-5de4bb46bad4 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:05.795915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 686/1375] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:05.801879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682074d-1c4a-4636-99aa-d1e0ca3d7051 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:05.802339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682074d-1c4a-4636-99aa-d1e0ca3d7051 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:05.802453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682074d-1c4a-4636-99aa-d1e0ca3d7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:05.822301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4682074d-1c4a-4636-99aa-d1e0ca3d7051 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:05.823562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4682074d-1c4a-4636-99aa-d1e0ca3d7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:05.832471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 690/1376] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:34:05.989751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bdc6d-adfc-40bb-a6a8-5de4bb46bad4 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:06.005522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bdc6d-adfc-40bb-a6a8-5de4bb46bad4 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:06.011124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:06.011766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:06.012050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:06.012325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:06.020839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:06.022472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1c110-4fa1-46a9-90ce-d1860f0e2d7a service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:06.032163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 687/1377] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:07.495217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccf0b-d310-495d-a63e-561d4df06fb1 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:07.495746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccf0b-d310-495d-a63e-561d4df06fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:07.495746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caccf0b-d310-495d-a63e-561d4df06fb1 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:07.497461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 691/1378] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:07.503837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72cb0-6ce0-4ccb-8722-89de8d76c4a7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:07.504315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72cb0-6ce0-4ccb-8722-89de8d76c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:07.504425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad72cb0-6ce0-4ccb-8722-89de8d76c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:07.523563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0ad72cb0-6ce0-4ccb-8722-89de8d76c4a7 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:07.524774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0ad72cb0-6ce0-4ccb-8722-89de8d76c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:07.533466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 688/1379] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:07.699085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caccf0b-d310-495d-a63e-561d4df06fb1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:07.716129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caccf0b-d310-495d-a63e-561d4df06fb1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:07.722419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:07.723089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:07.723371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:07.723650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:07.732934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:07.734941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81797086-3e5a-4001-843a-dacfc4280686 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:07.744799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 692/1380] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:09.240299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88e34-da3f-44d5-90c7-459a892d3e83 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:09.240870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88e34-da3f-44d5-90c7-459a892d3e83 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:09.240870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d88e34-da3f-44d5-90c7-459a892d3e83 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:09.242672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 689/1381] 10.222.0.76 () {54 vars in 911 bytes} [Thu Oct 28 08:34:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:09.248246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef700b4-00d7-45f9-9e63-7a71b4f7c088 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:09.248674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef700b4-00d7-45f9-9e63-7a71b4f7c088 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:09.248804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef700b4-00d7-45f9-9e63-7a71b4f7c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:09.266681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-eef700b4-00d7-45f9-9e63-7a71b4f7c088 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:09.267879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-eef700b4-00d7-45f9-9e63-7a71b4f7c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:09.276392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 693/1382] 10.222.0.76 () {58 vars in 1008 bytes} [Thu Oct 28 08:34:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:09.430892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88e34-da3f-44d5-90c7-459a892d3e83 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:09.445359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d88e34-da3f-44d5-90c7-459a892d3e83 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:09.450943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:09.451571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:09.451849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:09.452120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:09.460681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:09.462253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656260-28f0-4533-9eb8-26045e87af14 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:09.471572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 690/1383] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:11.770607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de18d-dc98-4297-bef2-0aeb74b77422 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:11.771142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de18d-dc98-4297-bef2-0aeb74b77422 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:11.771142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00de18d-dc98-4297-bef2-0aeb74b77422 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:11.773009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 694/1384] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:11.779869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79405f4f-6081-4434-846d-74ddbbd63083 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:11.780312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79405f4f-6081-4434-846d-74ddbbd63083 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:11.780438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79405f4f-6081-4434-846d-74ddbbd63083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:11.800196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-79405f4f-6081-4434-846d-74ddbbd63083 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:11.801518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-79405f4f-6081-4434-846d-74ddbbd63083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:11.809940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 691/1385] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:11.851897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de18d-dc98-4297-bef2-0aeb74b77422 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:11.863388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00de18d-dc98-4297-bef2-0aeb74b77422 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:11.867641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:11.868675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:11.869040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:11.869687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:11.886034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:11.887585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f9635-1f42-498a-948f-03d4d202a8df service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:11.898695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 695/1386] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:14.404473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb944ea-4cc5-4d11-a95e-7d3c6eb71262 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:14.404985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb944ea-4cc5-4d11-a95e-7d3c6eb71262 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:14.404985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb944ea-4cc5-4d11-a95e-7d3c6eb71262 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:14.406797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 692/1387] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:14.412670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddfae9-9e8d-46fd-ae55-8e2b1f345e8a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:14.413118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddfae9-9e8d-46fd-ae55-8e2b1f345e8a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:14.413227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddfae9-9e8d-46fd-ae55-8e2b1f345e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:14.432342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-03ddfae9-9e8d-46fd-ae55-8e2b1f345e8a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:14.433594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-03ddfae9-9e8d-46fd-ae55-8e2b1f345e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:14.442476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 696/1388] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:34:14.482697 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb944ea-4cc5-4d11-a95e-7d3c6eb71262 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:14.493831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb944ea-4cc5-4d11-a95e-7d3c6eb71262 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:14.497383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:14.498014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:14.498291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:14.498617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:14.508500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:14.510008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf8a72-9c22-478e-acf7-ddec8d053094 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:14.519880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 693/1389] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:17.169792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbcce3-7854-4fe2-89d1-9e28c17a6a5b None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:17.170376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbcce3-7854-4fe2-89d1-9e28c17a6a5b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:17.170376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbcce3-7854-4fe2-89d1-9e28c17a6a5b None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:17.173277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 697/1390] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:17.179210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a8ac-e386-4e5b-bc01-00ea08ee8892 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:17.179694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a8ac-e386-4e5b-bc01-00ea08ee8892 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:17.179803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a8ac-e386-4e5b-bc01-00ea08ee8892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:17.198407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-83c6a8ac-e386-4e5b-bc01-00ea08ee8892 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:17.199641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-83c6a8ac-e386-4e5b-bc01-00ea08ee8892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:17.207836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 694/1391] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:17.249535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbcce3-7854-4fe2-89d1-9e28c17a6a5b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:17.261706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbcce3-7854-4fe2-89d1-9e28c17a6a5b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:17.265214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:17.266446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:17.266755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:17.267033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:17.275786 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:17.277215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3de1e-afd2-4fb6-9bd3-b0db3883f119 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:17.287058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 698/1392] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:19.780417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeede51-1a8d-4ffd-92a9-8ff6ccd25c2a None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:19.781388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeede51-1a8d-4ffd-92a9-8ff6ccd25c2a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:19.781388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeede51-1a8d-4ffd-92a9-8ff6ccd25c2a None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:19.782909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 695/1393] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:19.789371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438da57-c54a-4711-b6ff-499cd74c1626 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:19.789892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438da57-c54a-4711-b6ff-499cd74c1626 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:19.790024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438da57-c54a-4711-b6ff-499cd74c1626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:19.808291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a438da57-c54a-4711-b6ff-499cd74c1626 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:19.809675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a438da57-c54a-4711-b6ff-499cd74c1626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:19.818787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 699/1394] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:19.861443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeede51-1a8d-4ffd-92a9-8ff6ccd25c2a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:19.874446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeede51-1a8d-4ffd-92a9-8ff6ccd25c2a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:19.878220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:19.878917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:19.879198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:19.879474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:19.888880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:19.890395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240b5c1-8391-4bbf-ba70-209f53e9397a service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:19.900722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 696/1395] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:22.289142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752f74-77ab-45c4-b4ba-0dea4fccc763 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:22.289731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752f74-77ab-45c4-b4ba-0dea4fccc763 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:22.289731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752f74-77ab-45c4-b4ba-0dea4fccc763 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:22.291570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 700/1396] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:22.297769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1228-16aa-4ea0-a041-00b2a0e8c630 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:22.298244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1228-16aa-4ea0-a041-00b2a0e8c630 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:22.298355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a1228-16aa-4ea0-a041-00b2a0e8c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:22.316411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d77a1228-16aa-4ea0-a041-00b2a0e8c630 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:22.317623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d77a1228-16aa-4ea0-a041-00b2a0e8c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:22.325929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 697/1397] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:22.367807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33752f74-77ab-45c4-b4ba-0dea4fccc763 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:22.380815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33752f74-77ab-45c4-b4ba-0dea4fccc763 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:22.384486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:22.385117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:22.385396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:22.385668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:22.398114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:22.399579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685d95d-bc65-45ee-bc65-f15ba5e5586a service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:22.410434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 701/1398] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:24.764954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79aa-ea16-4a61-8944-cd83116bbf88 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:24.765745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79aa-ea16-4a61-8944-cd83116bbf88 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:24.765745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79aa-ea16-4a61-8944-cd83116bbf88 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:24.767657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 698/1399] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:24.774199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09b81-f656-4360-9daf-b20f157737d4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:24.774711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09b81-f656-4360-9daf-b20f157737d4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:24.774828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c09b81-f656-4360-9daf-b20f157737d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:24.792502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a2c09b81-f656-4360-9daf-b20f157737d4 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:24.793699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a2c09b81-f656-4360-9daf-b20f157737d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:24.802180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 702/1400] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:24.842243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f79aa-ea16-4a61-8944-cd83116bbf88 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:24.853143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f79aa-ea16-4a61-8944-cd83116bbf88 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:24.856892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:24.857792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:24.857792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:24.858074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:24.867706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:24.869147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79282fb-477a-4169-9f5e-5b687e549bdf service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:24.880538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 699/1401] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:27.225667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee38-8c52-44ef-8634-3bc4f6567325 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:27.226192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee38-8c52-44ef-8634-3bc4f6567325 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:27.226302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087ee38-8c52-44ef-8634-3bc4f6567325 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:27.228053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 703/1402] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:27.234589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f1c3-395e-49c1-bd7e-ac05fceb05aa None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:27.235008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f1c3-395e-49c1-bd7e-ac05fceb05aa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:27.235122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4f1c3-395e-49c1-bd7e-ac05fceb05aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:27.254828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6ad4f1c3-395e-49c1-bd7e-ac05fceb05aa None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:27.256046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6ad4f1c3-395e-49c1-bd7e-ac05fceb05aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:27.263933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 700/1403] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:27.303745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ee38-8c52-44ef-8634-3bc4f6567325 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:27.315382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087ee38-8c52-44ef-8634-3bc4f6567325 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:27.319330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:27.319741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:27.320026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:27.320299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:27.329364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:27.330851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e31d2-facf-40ef-b486-fd96fe8e665e service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:27.340025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 704/1404] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:29.669635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4721d-04d4-4737-bef5-de3ca8a89361 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:29.670201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4721d-04d4-4737-bef5-de3ca8a89361 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:29.670201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4721d-04d4-4737-bef5-de3ca8a89361 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:29.672688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 701/1405] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:29.678854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919d76b-f0f3-4749-8cac-5b127070aa0d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:29.679291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919d76b-f0f3-4749-8cac-5b127070aa0d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:29.679394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919d76b-f0f3-4749-8cac-5b127070aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:29.697013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3919d76b-f0f3-4749-8cac-5b127070aa0d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:29.698205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3919d76b-f0f3-4749-8cac-5b127070aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:29.705946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 705/1406] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:29.745474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4721d-04d4-4737-bef5-de3ca8a89361 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:29.756210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4721d-04d4-4737-bef5-de3ca8a89361 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:29.759866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:29.760502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:29.760788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:29.761065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:29.770023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:29.771499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d345d2-4d58-41fb-ad73-c87ca1d451ea service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:29.781224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 702/1407] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:32.107629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907ca9-ea1e-48c7-ad04-e94e8c375e68 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:32.108222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907ca9-ea1e-48c7-ad04-e94e8c375e68 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:32.108222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907ca9-ea1e-48c7-ad04-e94e8c375e68 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:32.110083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 706/1408] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:32.115985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5443-78ee-40ae-9a49-ac50f0dc1fc3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:32.116427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5443-78ee-40ae-9a49-ac50f0dc1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:32.116540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf5443-78ee-40ae-9a49-ac50f0dc1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:32.134606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-43cf5443-78ee-40ae-9a49-ac50f0dc1fc3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:32.135793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-43cf5443-78ee-40ae-9a49-ac50f0dc1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:32.144266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 703/1409] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:32.183875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907ca9-ea1e-48c7-ad04-e94e8c375e68 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:32.195901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907ca9-ea1e-48c7-ad04-e94e8c375e68 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:32.199439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:32.200059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:32.200344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:32.200620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:32.209997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:32.211552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f4b74-50c9-4418-b9fa-6245a99da4c3 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:32.221603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 707/1410] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:34.533151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d66e-f059-41f8-8dcc-8faefe752de7 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:34.533687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d66e-f059-41f8-8dcc-8faefe752de7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:34.533687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6d66e-f059-41f8-8dcc-8faefe752de7 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:34.535475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 704/1411] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:34.541487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e3c6-a351-40c7-a429-7842cb996e3e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:34.541895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e3c6-a351-40c7-a429-7842cb996e3e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:34.542046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e3c6-a351-40c7-a429-7842cb996e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:34.560180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a089e3c6-a351-40c7-a429-7842cb996e3e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:34.561373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a089e3c6-a351-40c7-a429-7842cb996e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:34.569978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 708/1412] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:34.607808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6d66e-f059-41f8-8dcc-8faefe752de7 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:34.618893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6d66e-f059-41f8-8dcc-8faefe752de7 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:34.622401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:34.623072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:34.623355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:34.623629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:34.633284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:34.634796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d563cb-da14-4124-95cc-12c717a1d2bb service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:34.644248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 705/1413] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:51.929262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52380-e993-406b-ae14-30458cbfee96 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:51.929861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52380-e993-406b-ae14-30458cbfee96 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:51.929861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a52380-e993-406b-ae14-30458cbfee96 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:51.931556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 709/1414] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:51.938143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a353-7304-4683-a9f9-c89a3c727823 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:51.938678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a353-7304-4683-a9f9-c89a3c727823 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:51.938784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a353-7304-4683-a9f9-c89a3c727823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:51.956746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-38b1a353-7304-4683-a9f9-c89a3c727823 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:51.957944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-38b1a353-7304-4683-a9f9-c89a3c727823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:51.965791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 706/1415] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:52.019274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5daf66-4761-47de-a46a-27a62a2007c5 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:52.019565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5daf66-4761-47de-a46a-27a62a2007c5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:52.019840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5daf66-4761-47de-a46a-27a62a2007c5 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:52.021625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 710/1416] 10.222.0.76 () {54 vars in 962 bytes} [Thu Oct 28 08:34:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:34:52.027444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780feb-9d55-4e67-a652-9e5c7da27c8a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:52.027733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780feb-9d55-4e67-a652-9e5c7da27c8a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:52.028013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780feb-9d55-4e67-a652-9e5c7da27c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:52.046833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b8780feb-9d55-4e67-a652-9e5c7da27c8a None None] MFA Rules not processed for user `97167b82c21643c08543bf5d6323c599`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:52.047951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b8780feb-9d55-4e67-a652-9e5c7da27c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:52.054465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 707/1417] 10.222.0.76 () {58 vars in 1059 bytes} [Thu Oct 28 08:34:52 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:52.063245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5daf66-4761-47de-a46a-27a62a2007c5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:52.073682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5daf66-4761-47de-a46a-27a62a2007c5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:52.078069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:52.078509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:52.078804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:52.079079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:52.088441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:52.089794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc8ccf-cb80-46c4-a045-d2b5762505cf service glance] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:52.099740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 711/1418] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:34:54.471780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd97f-47d6-4307-92b7-2429db4e28fa None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:54.472324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd97f-47d6-4307-92b7-2429db4e28fa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:54.472324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bd97f-47d6-4307-92b7-2429db4e28fa None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:54.474036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 708/1419] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:54.480311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3191-77fb-4712-8597-5c9d99291a6c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:54.480767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3191-77fb-4712-8597-5c9d99291a6c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:54.480863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a3191-77fb-4712-8597-5c9d99291a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:54.498965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e39a3191-77fb-4712-8597-5c9d99291a6c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:54.500473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e39a3191-77fb-4712-8597-5c9d99291a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:54.508290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 712/1420] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:54.533985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd97f-47d6-4307-92b7-2429db4e28fa None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:54.547397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bd97f-47d6-4307-92b7-2429db4e28fa None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:54.551969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:54.552667 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:54.552951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:54.553233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:54.554010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:54.555943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2077b7-7af1-406a-83d1-6f8c7475c9b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:54.569860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 709/1421] 10.222.0.76 () {56 vars in 1108 bytes} [Thu Oct 28 08:34:54 2021] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:34:56.877084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404f17-7412-4c66-ae45-6d8f3dcff3da None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:56.877667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404f17-7412-4c66-ae45-6d8f3dcff3da None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:56.877667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5404f17-7412-4c66-ae45-6d8f3dcff3da None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:56.879509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 713/1422] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:56.885571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b8c9-c38e-4b41-b748-1047142d1204 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:56.885987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b8c9-c38e-4b41-b748-1047142d1204 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:56.886375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b8c9-c38e-4b41-b748-1047142d1204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:56.904639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4d32b8c9-c38e-4b41-b748-1047142d1204 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:56.906133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4d32b8c9-c38e-4b41-b748-1047142d1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:56.914696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 710/1423] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:56.960771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5404f17-7412-4c66-ae45-6d8f3dcff3da None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:56.976047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5404f17-7412-4c66-ae45-6d8f3dcff3da None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:56.981816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:56.982463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:56.982782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:56.983059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:56.992020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:56.993616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9026d-a72b-4ad9-9ce8-a767cb684f5c service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:57.003755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 714/1424] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:34:59.481629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e1b-034c-40f8-af51-337cd2685136 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:59.482172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e1b-034c-40f8-af51-337cd2685136 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:59.482172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe4e1b-034c-40f8-af51-337cd2685136 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:59.484163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 711/1425] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:34:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:34:59.490442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000854-6b8d-4112-9956-5124ba49d67a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:59.490945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000854-6b8d-4112-9956-5124ba49d67a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:59.491049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a000854-6b8d-4112-9956-5124ba49d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:59.509446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0a000854-6b8d-4112-9956-5124ba49d67a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:34:59.510710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0a000854-6b8d-4112-9956-5124ba49d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:34:59.519220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 715/1426] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:34:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:34:59.558052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe4e1b-034c-40f8-af51-337cd2685136 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:34:59.572261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe4e1b-034c-40f8-af51-337cd2685136 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:34:59.578741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:34:59.579872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:34:59.580389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:34:59.580895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:34:59.596100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:34:59.597579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe7092-7d04-41d6-8104-b625de64788b service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:34:59.608308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 712/1427] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:34:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:35:01.988714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee93ec-b254-4622-a7bf-21d661641e94 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:01.989250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee93ec-b254-4622-a7bf-21d661641e94 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:01.989250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee93ec-b254-4622-a7bf-21d661641e94 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:01.991015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 716/1428] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:35:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:35:01.996840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ccfe5-b12c-4151-a41a-a8eddd7ece3f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:01.997305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ccfe5-b12c-4151-a41a-a8eddd7ece3f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:01.997422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ccfe5-b12c-4151-a41a-a8eddd7ece3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:02.017101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-456ccfe5-b12c-4151-a41a-a8eddd7ece3f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:35:02.018421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-456ccfe5-b12c-4151-a41a-a8eddd7ece3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:35:02.026348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 713/1429] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:35:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:35:02.067442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee93ec-b254-4622-a7bf-21d661641e94 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:35:02.080096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee93ec-b254-4622-a7bf-21d661641e94 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:35:02.083680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:35:02.084323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:02.084604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:02.084878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:02.094594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:35:02.096050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2018d-4da3-4272-8a58-045a9bed6fb4 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:35:02.105987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 717/1430] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:35:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:35:04.490378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b13a-1b76-4882-83a2-d183315c99b0 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:04.490973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b13a-1b76-4882-83a2-d183315c99b0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:04.490973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b13a-1b76-4882-83a2-d183315c99b0 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:04.492668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 714/1431] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:35:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:35:04.498634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d840b0b-5b86-4392-8292-0fe1247272ed None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:04.499803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d840b0b-5b86-4392-8292-0fe1247272ed None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:04.500304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d840b0b-5b86-4392-8292-0fe1247272ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:04.517790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4d840b0b-5b86-4392-8292-0fe1247272ed None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:35:04.519022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4d840b0b-5b86-4392-8292-0fe1247272ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:35:04.526865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 718/1432] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:35:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:35:04.569353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b13a-1b76-4882-83a2-d183315c99b0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:35:04.580303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b13a-1b76-4882-83a2-d183315c99b0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:35:04.583975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:35:04.584605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:04.584888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:04.585166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:04.594390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:35:04.595860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2418b8-9eb9-40ee-b236-93519c87ffbd service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:35:04.605429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 715/1433] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:35:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:35:07.087874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47a5e-c21a-4b0b-96ba-fbf0c9dacac2 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:07.088746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47a5e-c21a-4b0b-96ba-fbf0c9dacac2 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:07.089033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47a5e-c21a-4b0b-96ba-fbf0c9dacac2 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:07.090891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 719/1434] 10.222.0.76 () {54 vars in 926 bytes} [Thu Oct 28 08:35:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:35:07.097349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1548-82c6-4c3a-947d-ce3319851d35 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:07.097746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1548-82c6-4c3a-947d-ce3319851d35 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:07.097911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1548-82c6-4c3a-947d-ce3319851d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:07.116257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a86d1548-82c6-4c3a-947d-ce3319851d35 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:35:07.117449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a86d1548-82c6-4c3a-947d-ce3319851d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:35:07.125925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 716/1435] 10.222.0.76 () {58 vars in 1023 bytes} [Thu Oct 28 08:35:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:35:07.167187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47a5e-c21a-4b0b-96ba-fbf0c9dacac2 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:35:07.177792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47a5e-c21a-4b0b-96ba-fbf0c9dacac2 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:35:07.181297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:35:07.181921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:35:07.182203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:35:07.182474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:35:07.192108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:35:07.193545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd205bb-8cb2-40d0-b165-2e3656962c2f service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:35:07.203481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 720/1436] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:35:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:36:18.084771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.085362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.085362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.105070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:36:18.106312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:18.114822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 717/1437] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:36:18.123655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.124284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.124284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.142702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:36:18.143968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:18.153296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 721/1438] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:36:18.158681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.168376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c7c5-0b84-48b1-92e8-e63caaf9bf7d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.174126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.174841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.175124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.175396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.176143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:36:18.176446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.178047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.192509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 718/1439] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:36:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:36:18.200640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.210353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ea4b-9010-4e65-a8e1-05cb95b76fe1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.215079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.215737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.216020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.216335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.217028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.218999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.261283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 722/1440] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:36:18.265718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.275796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613170d1-5641-4a64-80d1-05e4266461d2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.332772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.333452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.333742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.334024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.334838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.336729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.358568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 719/1441] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:36:18.362938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.373247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14574b4f-74a1-40e3-8d31-9a3e24fc8326 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.378562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.379228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.379509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.379788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.380526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.382148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.396809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 723/1442] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:36:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:36:18.400981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.411297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28124a97-9b7c-4d0b-b5bf-99b2f3a92a9a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.416053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.416712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.416994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.417287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.418000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.420887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de506f-fd98-4cfd-a9bb-d3c45b8aca6b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.434735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 720/1443] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:36:18 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:36:18.439035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.449059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686832b1-cfa1-474d-a826-fec2df11e95a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.454246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.455271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.455609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.455943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] PATH_INFO: `/v3/projects/f58daecd161f46d8ae05d33300bc9a75/users/cac576220e5a49bfbc824dd299f3cc0c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.471289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58daecd161f46d8ae05d33300bc9a75, user_id=cac576220e5a49bfbc824dd299f3cc0c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.474000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.488563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 724/1444] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:36:18 2021] PUT /identity/v3/projects/f58daecd161f46d8ae05d33300bc9a75/users/cac576220e5a49bfbc824dd299f3cc0c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:36:18.500846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df273-82e4-4057-a652-39fd8da95f35 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.501137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df273-82e4-4057-a652-39fd8da95f35 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.501418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df273-82e4-4057-a652-39fd8da95f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.526642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e04df273-82e4-4057-a652-39fd8da95f35 None None] MFA Rules not processed for user `cac576220e5a49bfbc824dd299f3cc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:36:18.527856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e04df273-82e4-4057-a652-39fd8da95f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:18.589892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 721/1445] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:36:18.602081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.674576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d2e1-1dd6-487e-b4bb-b6217215cff1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.682684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.683352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.683641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.683913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.693179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.695062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.704673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 725/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:36:18 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:36:18.773508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b868-71be-4563-903f-db2e918a54f5 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.773798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b868-71be-4563-903f-db2e918a54f5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.774078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b868-71be-4563-903f-db2e918a54f5 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.775813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 722/1447] 10.222.0.76 () {52 vars in 829 bytes} [Thu Oct 28 08:36:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:36:18.780373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:18.841167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62285-b63d-4f3b-918a-e3846f61eefc service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:18.846745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:18.847617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.847904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.848183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] PATH_INFO: `/v3/users/cac576220e5a49bfbc824dd299f3cc0c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:18.849420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac576220e5a49bfbc824dd299f3cc0c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:18.850441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:36:18.850441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:36:18.850441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:36:18.851683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:18.925956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac576220e5a49bfbc824dd299f3cc0c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:18.926866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac576220e5a49bfbc824dd299f3cc0c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:18.927672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac576220e5a49bfbc824dd299f3cc0c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:18.949610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac576220e5a49bfbc824dd299f3cc0c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:18.960177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac576220e5a49bfbc824dd299f3cc0c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:18.979030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 726/1448] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:36:18 2021] DELETE /identity/v3/users/cac576220e5a49bfbc824dd299f3cc0c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:36:18.983814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:18.984110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:18.984392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:19.002226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:36:19.003513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:19.064698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 723/1449] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:36:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:36:19.074627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:19.077263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:19.134181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45406-1eb4-4e11-9cf1-8b591a8ccd58 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:19.137832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:19.139692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:19.139976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:19.140251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:19.148945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:19.150376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9455d-2c60-4818-8b1a-d950d56b2041 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:19.159916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 727/1450] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:36:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:36:19.536843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:36:19.538295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:36:19.551818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9abc8-4e44-4d66-bfca-09e67b0facc3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:36:19.557132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:36:19.557316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:36:19.557577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:36:19.557875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] PATH_INFO: `/v3/projects/f58daecd161f46d8ae05d33300bc9a75` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:36:19.559124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58daecd161f46d8ae05d33300bc9a75)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:36:19.560884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:36:19.560884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:36:19.560884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:36:19.562798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:36:19.625886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58daecd161f46d8ae05d33300bc9a75', 'request_id': 'req-3de47c60-4521-4ce1-aac9-1b4696bd0067'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:19.640673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58daecd161f46d8ae05d33300bc9a75', 'request_id': 'req-3de47c60-4521-4ce1-aac9-1b4696bd0067'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:19.649968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58daecd161f46d8ae05d33300bc9a75', 'request_id': 'req-3de47c60-4521-4ce1-aac9-1b4696bd0067'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:19.668438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] The token cache is being invalidate because project f58daecd161f46d8ae05d33300bc9a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:36:19.668731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:19.670081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3de47c60-4521-4ce1-aac9-1b4696bd0067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:36:19.671494 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 724/1451] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:36:19 2021] DELETE /identity/v3/projects/f58daecd161f46d8ae05d33300bc9a75 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:37:51.710397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:51.711337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:51.711518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:51.713575 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 728/1452] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 08:37:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:37:51.719184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249f18-0a44-4143-ba14-02af79a48080 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:51.719701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249f18-0a44-4143-ba14-02af79a48080 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:51.719806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85249f18-0a44-4143-ba14-02af79a48080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:51.739511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-85249f18-0a44-4143-ba14-02af79a48080 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:37:51.740743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-85249f18-0a44-4143-ba14-02af79a48080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:37:51.798941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 725/1453] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 08:37:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:37:51.958374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:37:51.962135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:37:52.043072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6569b-177e-4ce6-8529-7d8f2567001d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:37:52.049333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:37:52.049999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:52.050289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:52.050606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:52.059694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:37:52.062271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d0b4-ca17-4ed2-b09e-e5c51d68acb8 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:37:52.076701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 729/1454] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:37:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:37:52.660090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6740-703b-47db-a02f-74852c6b6f09 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:52.660365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6740-703b-47db-a02f-74852c6b6f09 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:52.660730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6740-703b-47db-a02f-74852c6b6f09 None None] PATH_INFO: `/v3` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:52.661980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 726/1455] 10.222.0.70 () {54 vars in 925 bytes} [Thu Oct 28 08:37:52 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:37:52.669450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee9cc-9461-48ba-b336-ab70fed766dd None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:52.669771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee9cc-9461-48ba-b336-ab70fed766dd None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:52.670055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee9cc-9461-48ba-b336-ab70fed766dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:52.689981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-22bee9cc-9461-48ba-b336-ab70fed766dd None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:37:52.691330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-22bee9cc-9461-48ba-b336-ab70fed766dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:37:52.759861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 730/1456] 10.222.0.70 () {58 vars in 1015 bytes} [Thu Oct 28 08:37:52 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:37:53.562169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233111-b2fe-4f07-91a5-e7950f5d4853 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:53.562755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233111-b2fe-4f07-91a5-e7950f5d4853 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:53.562870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd233111-b2fe-4f07-91a5-e7950f5d4853 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:53.565647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 727/1457] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 08:37:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:37:53.571565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d5143-1446-4e67-b96c-1667088021a1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:53.571853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d5143-1446-4e67-b96c-1667088021a1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:53.572132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d5143-1446-4e67-b96c-1667088021a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:53.591212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-107d5143-1446-4e67-b96c-1667088021a1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:37:53.592446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-107d5143-1446-4e67-b96c-1667088021a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:37:53.600783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 731/1458] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 08:37:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:37:53.759555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd233111-b2fe-4f07-91a5-e7950f5d4853 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:37:53.774744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd233111-b2fe-4f07-91a5-e7950f5d4853 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:37:53.780144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:37:53.780791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:53.781072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:53.781344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:53.790233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:37:53.792077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de1e3-bd42-4c13-a934-9c3877acb520 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:37:53.804028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 728/1459] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:37:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:37:56.592612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92ce6-f91a-41f7-8cd8-f654ab3c5c3a None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:56.593895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92ce6-f91a-41f7-8cd8-f654ab3c5c3a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:56.594334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92ce6-f91a-41f7-8cd8-f654ab3c5c3a None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:56.597434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 732/1460] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:37:56 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:37:56.603772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113a44-9bba-4d7b-ac73-8b644d3cdee8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:56.604394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113a44-9bba-4d7b-ac73-8b644d3cdee8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:56.604394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5113a44-9bba-4d7b-ac73-8b644d3cdee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:56.623910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e5113a44-9bba-4d7b-ac73-8b644d3cdee8 None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:37:56.625239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e5113a44-9bba-4d7b-ac73-8b644d3cdee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:37:56.634404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 729/1461] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:37:56 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:37:56.642963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92ce6-f91a-41f7-8cd8-f654ab3c5c3a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:37:56.665439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92ce6-f91a-41f7-8cd8-f654ab3c5c3a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:37:56.671245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:37:56.671923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:37:56.672205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:37:56.672484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:37:56.682931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:37:56.686875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f2401-a185-48e5-84d9-663abd401f11 service placement] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:37:56.699108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 733/1462] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:37:56 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:38:05.772103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f164-5ffa-486f-9941-487a17ce8d6d None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:05.772685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f164-5ffa-486f-9941-487a17ce8d6d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:05.772685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f164-5ffa-486f-9941-487a17ce8d6d None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:05.774485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 730/1463] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 08:38:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:05.781093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78f3-4185-4dc0-bcfc-da2b06080cb6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:05.781588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78f3-4185-4dc0-bcfc-da2b06080cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:05.782877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a78f3-4185-4dc0-bcfc-da2b06080cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:05.808375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-711a78f3-4185-4dc0-bcfc-da2b06080cb6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:05.809610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-711a78f3-4185-4dc0-bcfc-da2b06080cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:05.817533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 734/1464] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 08:38:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:38:05.977093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023f164-5ffa-486f-9941-487a17ce8d6d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:05.992462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023f164-5ffa-486f-9941-487a17ce8d6d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:05.998666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:05.999327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:05.999608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:05.999878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:06.009320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:06.010983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a705a8-f0aa-4c09-909f-e847befd9752 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:06.022236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 731/1465] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:38:07.493085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c205d6-65cb-42d8-adb3-d922506d6abd None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:07.493732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c205d6-65cb-42d8-adb3-d922506d6abd None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:07.493732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c205d6-65cb-42d8-adb3-d922506d6abd None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:07.495688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 735/1466] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 28 08:38:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:38:07.501853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011816e-40b9-48c6-9ce4-0cab638aa513 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:07.502380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011816e-40b9-48c6-9ce4-0cab638aa513 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:07.502488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011816e-40b9-48c6-9ce4-0cab638aa513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:07.522326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0011816e-40b9-48c6-9ce4-0cab638aa513 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:07.523589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0011816e-40b9-48c6-9ce4-0cab638aa513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:07.531555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 732/1467] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 28 08:38:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:38:07.699829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c205d6-65cb-42d8-adb3-d922506d6abd None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:07.716009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c205d6-65cb-42d8-adb3-d922506d6abd None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:07.722419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:07.723120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:07.723401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:07.723670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:07.732955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:07.734609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ab69f-0965-4a5d-88ee-fa33f87fbda0 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:07.746093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 736/1468] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:38:12.292158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:12.292696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:12.292696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:12.294426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 733/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 08:38:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:12.301181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524abe-a495-4293-b76e-f894b5010ec6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:12.301690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524abe-a495-4293-b76e-f894b5010ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:12.301806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524abe-a495-4293-b76e-f894b5010ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:12.320935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-28524abe-a495-4293-b76e-f894b5010ec6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:12.322334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-28524abe-a495-4293-b76e-f894b5010ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:12.331100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 737/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 08:38:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:38:12.371395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:12.373132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:12.445254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9a77d-7fa8-4d82-9e45-a0fb5986424f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:12.448767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:12.449415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:12.449693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:12.449966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:12.460225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:12.461660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e2cfb-4c43-4b2d-b5de-1bf1fadf3a70 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:12.471540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 734/1471] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:38:14.867738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b385d9-6e67-449d-81c6-98cbf141461d None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:14.868597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b385d9-6e67-449d-81c6-98cbf141461d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:14.868597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b385d9-6e67-449d-81c6-98cbf141461d None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:14.870862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 738/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 08:38:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:14.878399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d994-db74-4dc2-a8ec-585582970454 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:14.878975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d994-db74-4dc2-a8ec-585582970454 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:14.879072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d994-db74-4dc2-a8ec-585582970454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:14.898991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8a36d994-db74-4dc2-a8ec-585582970454 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:14.900247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8a36d994-db74-4dc2-a8ec-585582970454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:14.908668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 735/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 08:38:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:38:14.947363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b385d9-6e67-449d-81c6-98cbf141461d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:14.958211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b385d9-6e67-449d-81c6-98cbf141461d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:14.961711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:14.962343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:14.962658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:14.962937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:14.972176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:14.973640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d29864-fe0f-41e5-a8fd-2286019671db service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:14.983411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 739/1474] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:38:19.175104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:19.175672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:19.175672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:19.177512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 736/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 08:38:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:19.183635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3b3c-a828-4a5d-91db-33a6fc02d676 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:19.184285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3b3c-a828-4a5d-91db-33a6fc02d676 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:19.184285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3b3c-a828-4a5d-91db-33a6fc02d676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:19.203209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a63a3b3c-a828-4a5d-91db-33a6fc02d676 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:19.204433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a63a3b3c-a828-4a5d-91db-33a6fc02d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:19.213023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 740/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 08:38:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:38:19.268184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:19.271701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:19.332100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce014c3-7548-48c4-b0de-65121431f67e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:19.335800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:19.336459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:19.336746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:19.337018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:19.346606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:19.348151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f2e64-478e-48bc-aa4f-60e58681d205 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:19.358311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 737/1477] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:38:21.683292 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8da6-4803-4dad-ba05-5c46164b0540 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:21.683839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8da6-4803-4dad-ba05-5c46164b0540 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:21.683839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd8da6-4803-4dad-ba05-5c46164b0540 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:21.685735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 741/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Oct 28 08:38:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:21.692415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f727-1ffd-4455-be9b-0e7da19ec290 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:21.692923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f727-1ffd-4455-be9b-0e7da19ec290 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:21.693029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4f727-1ffd-4455-be9b-0e7da19ec290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:21.712002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-dbf4f727-1ffd-4455-be9b-0e7da19ec290 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:21.712545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dbf4f727-1ffd-4455-be9b-0e7da19ec290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:21.721470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 738/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Oct 28 08:38:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:38:21.776645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a452-16f3-4fa1-a589-5353cf520a2e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:21.776934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a452-16f3-4fa1-a589-5353cf520a2e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:21.777218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a452-16f3-4fa1-a589-5353cf520a2e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:21.779060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 742/1480] 10.222.0.76 () {54 vars in 962 bytes} [Thu Oct 28 08:38:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:38:21.785532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864c63-5ee3-4834-a739-4593290e4538 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:21.785894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864c63-5ee3-4834-a739-4593290e4538 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:21.786255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8864c63-5ee3-4834-a739-4593290e4538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:21.805480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f8864c63-5ee3-4834-a739-4593290e4538 None None] MFA Rules not processed for user `64c05096a69740909d10c748be820840`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:38:21.806742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f8864c63-5ee3-4834-a739-4593290e4538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:38:21.813424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 739/1481] 10.222.0.76 () {58 vars in 1059 bytes} [Thu Oct 28 08:38:21 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:38:21.821664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a452-16f3-4fa1-a589-5353cf520a2e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:38:21.832880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a452-16f3-4fa1-a589-5353cf520a2e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:38:21.836514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:38:21.837149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:38:21.837430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:38:21.837705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:38:21.847582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:38:21.849034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ea2e-0807-4dc2-b269-0bb40b1dd89e service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:38:21.859082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 743/1482] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:38:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:47.219193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.219784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.219784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.247547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.248939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.260322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 740/1483] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.276351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.276935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.276935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.301901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.303444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.322051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 744/1484] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.327156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.343910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97efa-ea16-4e2e-9926-b5d917efbbc2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.353014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.353619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.353937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.354217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.355006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:47.355313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.356968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.376700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 741/1485] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:47.385483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.401021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5190-c663-495c-9212-ed79ed747821 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.409521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.410201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.410512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.410795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.411521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.413515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa50d-52be-41cf-bb55-e873cf0c8706 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.461509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 745/1486] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:47.465789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.475973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb0db-c822-4c64-806b-4ab4484de5c1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.476323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb0db-c822-4c64-806b-4ab4484de5c1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.476576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eb0db-c822-4c64-806b-4ab4484de5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.484857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703fb77-be6b-431a-9ad9-39bd1c36e298 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.510744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-487eb0db-c822-4c64-806b-4ab4484de5c1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.513084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-487eb0db-c822-4c64-806b-4ab4484de5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.631330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.639463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.639463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.639463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.639463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.639463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852ff89-8ce0-472d-9bd1-946e7a816fbd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.642605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 746/1487] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:39:47.644229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a38b-e071-4dc5-91b3-5aa08d2f5421 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.645396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a38b-e071-4dc5-91b3-5aa08d2f5421 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.645735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532a38b-e071-4dc5-91b3-5aa08d2f5421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.661617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 742/1488] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:47.662995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239dbeb-f400-4a4d-ba5d-1cfd78dd91a6 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.663348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239dbeb-f400-4a4d-ba5d-1cfd78dd91a6 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.663638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239dbeb-f400-4a4d-ba5d-1cfd78dd91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.675463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f532a38b-e071-4dc5-91b3-5aa08d2f5421 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.676689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f532a38b-e071-4dc5-91b3-5aa08d2f5421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.695417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a239dbeb-f400-4a4d-ba5d-1cfd78dd91a6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.695814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 747/1489] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.696658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a239dbeb-f400-4a4d-ba5d-1cfd78dd91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.697828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e855b-8c9a-49bf-8fa7-ce6db9eef875 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.698448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e855b-8c9a-49bf-8fa7-ce6db9eef875 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.699019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e855b-8c9a-49bf-8fa7-ce6db9eef875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.720182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-317e855b-8c9a-49bf-8fa7-ce6db9eef875 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.721702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-317e855b-8c9a-49bf-8fa7-ce6db9eef875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.730228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 748/1490] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.731886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 743/1491] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.733123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.733420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.733700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.741280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fbb79-ef76-4e92-98f5-266674568cd0 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.741280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fbb79-ef76-4e92-98f5-266674568cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.741280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fbb79-ef76-4e92-98f5-266674568cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.768364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.769578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.775062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-117fbb79-ef76-4e92-98f5-266674568cd0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.776409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-117fbb79-ef76-4e92-98f5-266674568cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.782058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 744/1492] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.783120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.784740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 749/1493] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.786539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca7e6-68a0-46e9-bf5c-d421e06b40c0 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.787162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca7e6-68a0-46e9-bf5c-d421e06b40c0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.787628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca7e6-68a0-46e9-bf5c-d421e06b40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.797124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1666010-3ff5-428c-83c2-9a6cb32b2d36 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.802526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.803235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.803521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.803794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.804542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.806199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8b196-5458-421d-8270-ee81adfdb562 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.811600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1baca7e6-68a0-46e9-bf5c-d421e06b40c0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.812894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1baca7e6-68a0-46e9-bf5c-d421e06b40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.817436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 745/1494] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:47.821469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc0c9-36fd-49e0-893b-6bb83af3be28 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.821761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc0c9-36fd-49e0-893b-6bb83af3be28 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.822147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 750/1495] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.822284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dc0c9-36fd-49e0-893b-6bb83af3be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.823485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.823775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.824052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.840852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ac3dc0c9-36fd-49e0-893b-6bb83af3be28 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.842064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ac3dc0c9-36fd-49e0-893b-6bb83af3be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.842402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.843617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.850380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 746/1496] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.851922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359261-a2e7-4a6c-b401-e0869e818f8e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.852058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 751/1497] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.852297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359261-a2e7-4a6c-b401-e0869e818f8e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.852578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6359261-a2e7-4a6c-b401-e0869e818f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.852762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.864869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af839b-95ee-4bb0-92fa-bdb1956af39f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.872288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f6359261-a2e7-4a6c-b401-e0869e818f8e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.872489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.873503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f6359261-a2e7-4a6c-b401-e0869e818f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.873631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.874026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.874516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.875883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:47.877071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.878935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.882589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 747/1498] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.883937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.884230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.884512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.896513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 752/1499] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:47.897603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.903368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.904686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.908844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f2a60-6fa5-4178-86e5-5cc685717fcf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.913505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.917200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 748/1500] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.917337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.917337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.917337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.917649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.917750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.917750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f7dcc-483a-41d9-9c92-a0006272f2b6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.925783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0f887-8e9e-4d99-9865-310d36f27b76 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.929035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 753/1501] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:47.930405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.930724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.931014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.931964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.932768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.933053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.933331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.934087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:47.934398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.936064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.950459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 749/1502] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:47.950696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:47.950820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.950914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:47.959129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 754/1503] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:47.959545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b275491-dd1a-405e-bee6-df7e1ca886fe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.960130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:47.964359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.965027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.965315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.965594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.966423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:47.967368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.969073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061e7f-e015-41f3-96df-ae0f379a8652 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.970258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99604dde-1872-48a7-92a4-06ec5998cd50 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:47.975062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:47.975967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.976255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.976566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:47.977308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:47.977614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:47.979248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:47.981327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 750/1504] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:47.982634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:47.982931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:47.983214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.000345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 755/1505] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:48.000345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.002296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:48.003726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:48.010458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b50032-6f72-4ae6-b0a9-768239f2a4cd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.011743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 751/1506] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:48.012523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.018842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.019544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.019830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.020112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.020828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.021986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4597ce-07b0-43dd-8300-417ae56b0bbf None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.022936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.026752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.027402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.027688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.027964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.028702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:48.029011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.030643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.042819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 752/1507] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:48.043643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.049655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 756/1508] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:47 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.050468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.054752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857a8e6-8ddd-4f22-8248-2ead329acbaa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.113769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b04b01-980b-48bf-ace5-03b39825eccd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.118642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.119145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.119316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.119578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.119879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.120034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.120317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.120588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.120690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] PATH_INFO: `/v3/projects/3831003e70cf4a62afb1393fbea6654e/users/e0a3f84e4d9b4c77aab465f1e4df493d/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.122717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e49d32-c0f5-49c5-acdb-7e3b20486e70 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.135138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=3831003e70cf4a62afb1393fbea6654e, user_id=e0a3f84e4d9b4c77aab465f1e4df493d, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.137836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.152516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 757/1509] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.152516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.152774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 753/1510] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:48 2021] PUT /identity/v3/projects/3831003e70cf4a62afb1393fbea6654e/users/e0a3f84e4d9b4c77aab465f1e4df493d/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:48.152774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.154044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.154352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.172577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:48.174427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:48.213012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d40f6-c071-46ef-83b2-84ea9d891ead admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.232101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 758/1511] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:48.232928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.242200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17756b7a-8020-4aec-8911-f5f9e9387ed2 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.246974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.247625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.247912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.248192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.248902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.250934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.269265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.269983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.270223 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.270615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.271328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.273239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.280284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 759/1512] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.281258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.302540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 754/1513] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.303425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.342618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606576cc-4856-4b74-aded-e38b1377121b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.366940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8d28-b34e-4df2-867f-c2a8e590da19 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.371790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.372468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.372800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.373079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.373786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.375831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.401304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 755/1514] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.401304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.403378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.404077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.404362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.404809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.405384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:48.405689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.407356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.409897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6cc3d-803e-47bf-9949-4d972ea91f33 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.414723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.415467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.415715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.415928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.416641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.418579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb1d88-13f1-416d-b86d-ca6ad7a7b769 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.419227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 760/1515] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:48.423984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.433763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461883d-900e-444a-a0c6-51439a1f2c56 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.439382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.440169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.440453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.440734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.441444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.443405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.445895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 756/1516] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.447317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.447613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.447919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.468037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 761/1517] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.468037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.468348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:48.468348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:48.478288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab388-026a-4092-9b1c-29b597413a61 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.525623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 757/1518] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:48.526546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.535964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311bb5-a263-40f9-9003-eabc85d11a79 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.536140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.536707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.536988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.537259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.538133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:48.538536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.540108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.541076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.541746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.542028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.542298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.543176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.545111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.553288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 762/1519] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:48.554120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.567473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b607c4-05e8-4fdc-8d65-04395851fedb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.574278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 758/1520] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.574278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.574545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.574545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.574545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.574545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.574926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.576535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.581922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d2cbd-48ff-414a-81d8-702bfbe90761 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.587049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.587724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.588009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.588348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.589120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.590984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.597245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 763/1521] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.598113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.601848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 759/1522] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.602566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.609001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a449-1d1f-41e4-b985-47fee3f0805b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.613026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9a577-5f24-4fe6-bf64-fda4ca5b9776 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.614367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.615062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.615347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.615628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.616330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.617761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.618228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.618416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.618733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.619013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.619713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.621628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.643116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 760/1523] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.643947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.650721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 764/1524] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.650721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.653573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef14f1-a8f0-4147-abed-c225aba6be9b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.702394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e15b-a234-4542-aead-747de0e87a27 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.706595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.707244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.707527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.707802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.709506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.710211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.710514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.710810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.711551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.713190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.717109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.718584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.724284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 761/1525] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.725110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.728740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 765/1526] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:48.729438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.735312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8e7d0-ca45-4622-bdc7-2ba1c706e68f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.739320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fec45-41fd-4d15-88db-22c8584b122f service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.741101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.741763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.742043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.742315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.743066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.744506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.744970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.745508 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.745954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.746545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.747461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.749245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.760646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 766/1527] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.761499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.771826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4581-6b0a-4175-aa0f-00225455f09b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.777237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.777904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.778190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.778469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.779244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.780894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.785838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 762/1528] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.785838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.796861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 767/1529] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.796861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.811059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856551-8b66-4afe-934e-411d22c8fc6e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.855599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c20c-2e9c-45f1-acbd-26cd3591b846 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.862570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.864037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.864394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.864597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.865727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.867800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.876915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.877541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.877830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.878114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.878359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 763/1530] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.879236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.882431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.884221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.889186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5823-3966-4a11-86f5-ee6a3dee2d7f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.895618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.896404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.897048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.897339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.898087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.899804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 768/1531] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.900535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.900956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.924761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b9d4-304d-4e7d-9683-031703b4cb8f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.932308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.933208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.933574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.933923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.934896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.935572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 764/1532] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 296 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:48.936555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.937131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.948179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499d23b-22e8-4968-838f-c8d7c89ef5a1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.953511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.954215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 769/1533] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.954946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.955528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.955803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.956264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.957261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.959148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.967786 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc45341-863c-4a53-a89b-5189283c6d84 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.974096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 765/1534] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:48.975280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:48.975491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.976560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.976940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.977349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.978224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.980380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:48.988801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a057b0-08a1-4946-b815-771960c2023b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:48.994782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:48.996017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:48.996611 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:48.997133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:48.998069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:48.999865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.003528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 770/1535] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:48 2021] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:49.007345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.013453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 766/1536] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.014324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.020920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553e6ec-bc4a-4a7b-911c-8f49669274a9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.027221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092eefd-df89-4ca5-8670-5bed3c1bad04 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.027535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.028422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.028703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.028970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] PATH_INFO: `/v3/projects/6fca104eab6c4383a987eba03d994d4a/users/cead6ffa9c3c4549a9c13333626ac71c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.033276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.033706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.033993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.034269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.035052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.036658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.045842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fca104eab6c4383a987eba03d994d4a, user_id=cead6ffa9c3c4549a9c13333626ac71c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.051058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 767/1537] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.051058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.051310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.064792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea934ce3-966b-4dca-a355-49cfae7cff65 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.066401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 771/1538] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/6fca104eab6c4383a987eba03d994d4a/users/cead6ffa9c3c4549a9c13333626ac71c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.066401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.150452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826d4e-d2ca-4ef6-9cc8-bf635d160864 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.156146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.157010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.157297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.158353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] PATH_INFO: `/v3/projects/d12dfed3afe746b58b897b104b2a78ae/users/483af16bae1f4521ad3e3138bbc86123/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.168658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.169650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.169650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.169913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.170873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.172495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.177591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12dfed3afe746b58b897b104b2a78ae, user_id=483af16bae1f4521ad3e3138bbc86123, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.180407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.184016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 768/1539] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.184920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.196584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4901c2-00fc-4941-9756-41e88a54f27c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.205852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 772/1540] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/d12dfed3afe746b58b897b104b2a78ae/users/483af16bae1f4521ad3e3138bbc86123/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.206721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.261537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.262447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.262761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.263042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] PATH_INFO: `/v3/projects/caed8624c42e4e4aab79cb3ca12ef824/users/a8a8c3c685aa49499037c493b1b99eed/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.278426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e784f-43ef-4061-80f1-f2c92a9c86df admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.280932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caed8624c42e4e4aab79cb3ca12ef824, user_id=a8a8c3c685aa49499037c493b1b99eed, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.284263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.284658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.285338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.285626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.285897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.286680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.288283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.299111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 769/1541] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/caed8624c42e4e4aab79cb3ca12ef824/users/a8a8c3c685aa49499037c493b1b99eed/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.300393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.300993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 773/1542] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.301818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.316024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff564715-479f-4ac5-8745-c569a7bf48d9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.369841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0562cb4-16ee-432e-bc98-9902a00c5419 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.374784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.375795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.376085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.376598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] PATH_INFO: `/v3/projects/b13cff8b20714a9da7bb1c6e6749bfb0/users/7e504cc0e7f44b0184eefe6950d7af3b/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.381123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.382074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.382360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.382697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] PATH_INFO: `/v3/projects/4e1ab98d27254ae9b953182c6f2d1fc1/users/b4e000da3af24420a5d27011dc2fb95a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.392755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13cff8b20714a9da7bb1c6e6749bfb0, user_id=7e504cc0e7f44b0184eefe6950d7af3b, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.395662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88971e-1fe8-4d8c-b1ba-6b9f685d0243 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.398613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1ab98d27254ae9b953182c6f2d1fc1, user_id=b4e000da3af24420a5d27011dc2fb95a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.401320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.421602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 770/1543] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/b13cff8b20714a9da7bb1c6e6749bfb0/users/7e504cc0e7f44b0184eefe6950d7af3b/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.421602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395d32-2070-469a-898a-f1cdc9250d97 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.421602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395d32-2070-469a-898a-f1cdc9250d97 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.421602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395d32-2070-469a-898a-f1cdc9250d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.422204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 774/1544] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/4e1ab98d27254ae9b953182c6f2d1fc1/users/b4e000da3af24420a5d27011dc2fb95a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.422204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.446665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-02395d32-2070-469a-898a-f1cdc9250d97 None None] MFA Rules not processed for user `cead6ffa9c3c4549a9c13333626ac71c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.448143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-02395d32-2070-469a-898a-f1cdc9250d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.494565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82959e22-3f09-4a49-9640-a683b3897589 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.500077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.500754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.501042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.501955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.502743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.504377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92780699-2aea-485f-b206-d6a61a2b4fd4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.514561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 775/1545] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.515877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.516166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.516442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.527142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 771/1546] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.533060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66375a-4a36-48bb-a973-c6c5cdf3259c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.533796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66375a-4a36-48bb-a973-c6c5cdf3259c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.533796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66375a-4a36-48bb-a973-c6c5cdf3259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.536459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.537674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.545927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 776/1547] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.546606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.553625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2e66375a-4a36-48bb-a973-c6c5cdf3259c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.554993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2e66375a-4a36-48bb-a973-c6c5cdf3259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.560953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f726560-9339-49e2-9c9e-025872fc7a21 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.563063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 772/1548] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.566981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.567653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.567970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.568372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.568472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba02aa-f598-4de6-a9e6-236587452e2a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.568682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba02aa-f598-4de6-a9e6-236587452e2a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.568967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba02aa-f598-4de6-a9e6-236587452e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.569516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.571196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5b987-c2c9-4465-80cd-acd864972cd7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.581857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 777/1549] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:49.583206 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.583492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.583766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.592808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d4ba02aa-f598-4de6-a9e6-236587452e2a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.594106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d4ba02aa-f598-4de6-a9e6-236587452e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.606259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 773/1550] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.607655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.607947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.608229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.613187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] MFA Rules not processed for user `7e504cc0e7f44b0184eefe6950d7af3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.614455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.650056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] MFA Rules not processed for user `e0a3f84e4d9b4c77aab465f1e4df493d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:49.651348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:49.687245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 778/1551] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.690072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.706430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8b29-2a11-47c0-ac82-5e60ba198d22 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.711455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.712502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.712795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.713073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] PATH_INFO: `/v3/projects/241b556f8519472bb4fbe40400334a65/users/aaeb0fe842e54e3b9f0750069d83231c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.730181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241b556f8519472bb4fbe40400334a65, user_id=aaeb0fe842e54e3b9f0750069d83231c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.733067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.733575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 774/1552] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:49.734254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.747511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d2c36-0733-4298-8b45-ec0d2ba6ad24 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.752704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 779/1553] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/241b556f8519472bb4fbe40400334a65/users/aaeb0fe842e54e3b9f0750069d83231c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.753759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.813583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.814314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.814699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.814976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.815690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3dfc4-d0a1-4252-96c8-e6e1ed44d595 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.815828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.817631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.819344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.819993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.820271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.820541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.829892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.831379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.842592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 780/1554] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:49.843417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.848137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 775/1555] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:49 2021] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:49.849221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.852405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce067887-9942-49e3-af78-b1da853617c9 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.913193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.913859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.914145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.914472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.931126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069a5b-1185-4a6d-b7bb-af6cefb2b5ee admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:49.938488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:49.939861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:49.940172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:49.940430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] PATH_INFO: `/v3/projects/acbc2e76166240e5ac899c310cbc4ac6/users/2bdd4f13216d410794b2dff3f5c162dc/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:49.959083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbc2e76166240e5ac899c310cbc4ac6, user_id=2bdd4f13216d410794b2dff3f5c162dc, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:49.962454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:49.978557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 776/1556] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:49 2021] PUT /identity/v3/projects/acbc2e76166240e5ac899c310cbc4ac6/users/2bdd4f13216d410794b2dff3f5c162dc/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:49.979418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:49.981487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.004019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.005534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35836-576a-4a8e-9984-bcc9515e3671 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.030080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 781/1557] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:50.031558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b9f-5f03-4993-bf8f-6d26f2a48caa None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.031955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b9f-5f03-4993-bf8f-6d26f2a48caa None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.032217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d736b9f-5f03-4993-bf8f-6d26f2a48caa None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.035886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 782/1558] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:39:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:50.036744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1572cc-f1f2-4bdf-b420-4632b4099cd5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.037035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1572cc-f1f2-4bdf-b420-4632b4099cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.037311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1572cc-f1f2-4bdf-b420-4632b4099cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.057181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bf1572cc-f1f2-4bdf-b420-4632b4099cd5 None None] MFA Rules not processed for user `e0a3f84e4d9b4c77aab465f1e4df493d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:50.058718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bf1572cc-f1f2-4bdf-b420-4632b4099cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.065477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de0fa7-df3c-40c1-9134-4ea94ab19944 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.070033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.070832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.071204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.071574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.137432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 783/1559] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:50.138858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76898-0ea5-438e-8b6e-022415841d4e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.139194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76898-0ea5-438e-8b6e-022415841d4e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.139476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76898-0ea5-438e-8b6e-022415841d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.147017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.148496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.160992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 777/1560] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:50.161626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.162816 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e1f76898-0ea5-438e-8b6e-022415841d4e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:50.165148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e1f76898-0ea5-438e-8b6e-022415841d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.171490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8464420-508a-49ed-a0af-0c421a4b8526 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.175486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 784/1561] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:50.176941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87bac-7cfb-4658-ac53-9ea56614de65 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.177236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87bac-7cfb-4658-ac53-9ea56614de65 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.177517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87bac-7cfb-4658-ac53-9ea56614de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.179293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.180236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.180799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.181286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.182240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.186436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17b8d1-2bbd-4da4-ac3c-44b4de03ae9a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.213037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c7c87bac-7cfb-4658-ac53-9ea56614de65 None None] MFA Rules not processed for user `2bdd4f13216d410794b2dff3f5c162dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:50.214373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c7c87bac-7cfb-4658-ac53-9ea56614de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.217573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 778/1562] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:50.219252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.219668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.220946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.247341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:50.249057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.317454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 785/1563] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:50.319352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18790f-f340-480e-bf9d-8f8b2ca56050 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.319648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18790f-f340-480e-bf9d-8f8b2ca56050 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.319974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18790f-f340-480e-bf9d-8f8b2ca56050 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.321809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 786/1564] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:39:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:50.322631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18790f-f340-480e-bf9d-8f8b2ca56050 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.336911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18790f-f340-480e-bf9d-8f8b2ca56050 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.346100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.346382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 779/1565] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:50.347299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.347589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.347864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.356782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.368747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2928b29-1fd0-4c8c-a39b-74bf03e1b27c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.371255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.372586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d203f8-b400-4a6d-9dc8-03aa74d71679 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.375614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.375805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.376755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.377012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.377801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.379836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.395780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 780/1566] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:50.397543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.399836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 787/1567] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:50.401328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.401528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.401752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.409829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf98-45f7-4f12-96b9-95dc50243650 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.416285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.417032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.417321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.417601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.418377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.420915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.431660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:50.433001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:50.446914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 788/1568] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:50.447971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.462531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29774cc8-c802-4a9f-9dc1-8d73bd6806e7 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.473253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.475909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 781/1569] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:50.476199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.476497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.476776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.478273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.576747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.579006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.590177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 789/1570] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:50.591213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.602881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e020-6427-4977-86ec-65fc16e1b922 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.612136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba948-2537-479f-a61e-6854b7468f34 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.628199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.630293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.633182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.633587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] PATH_INFO: `/v3/projects/948d99d4e42f483e9a2a250591092c8c/users/f4ad4c2fe0af473d8aea89e1c7e90842/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.667628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948d99d4e42f483e9a2a250591092c8c, user_id=f4ad4c2fe0af473d8aea89e1c7e90842, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.673868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.700967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 782/1571] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:50 2021] PUT /identity/v3/projects/948d99d4e42f483e9a2a250591092c8c/users/f4ad4c2fe0af473d8aea89e1c7e90842/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:50.701924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.761396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.762236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.762660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.763039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.867779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ec517-992f-4950-b329-f6fbdf562a58 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.883548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.884423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.884809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.885405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.886054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.894553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.895011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.900308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.925632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 790/1572] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:50.928014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.936293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 783/1573] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:50 2021] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:50.941911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.952196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5208b06-4118-4214-8dce-6ebe349deca2 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.960139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b44ee-09d1-490a-9a63-07b8d213c784 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.961248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.962163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.962639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.963091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.964067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.965981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.966418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:50.967625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:50.968282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:50.968662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:50.970919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:50.973167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:50.983908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 791/1574] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:50.985023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:50.994970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 784/1575] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:50 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:50.996871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af74c2-c37b-4c3c-95d4-55556d2345f1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:50.999272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.008174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.009506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.012120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.012607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] PATH_INFO: `/v3/projects/948d99d4e42f483e9a2a250591092c8c/users/f4ad4c2fe0af473d8aea89e1c7e90842/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.019908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=948d99d4e42f483e9a2a250591092c8c, user_id=f4ad4c2fe0af473d8aea89e1c7e90842, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.023680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e3739-fc9f-418d-84db-6a96bb87851b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.025243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed5b77-76fe-4757-9aa4-e3c3cfd406ac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.035339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.038149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.039604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.039908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] PATH_INFO: `/v3/projects/480e8875b51a460bbbaaa0832f73e1b5/users/4db14bfab8ff426b9997c8025e7fc620/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.064081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 792/1576] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:50 2021] PUT /identity/v3/projects/948d99d4e42f483e9a2a250591092c8c/users/f4ad4c2fe0af473d8aea89e1c7e90842/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:51.068419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f85dc-210d-4551-9739-9eb4f5feeac6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.068713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f85dc-210d-4551-9739-9eb4f5feeac6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.070606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f85dc-210d-4551-9739-9eb4f5feeac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.097923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e8875b51a460bbbaaa0832f73e1b5, user_id=4db14bfab8ff426b9997c8025e7fc620, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.105815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b770e-6711-41b4-87ba-1d93719ca461 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.132616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 785/1577] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:50 2021] PUT /identity/v3/projects/480e8875b51a460bbbaaa0832f73e1b5/users/4db14bfab8ff426b9997c8025e7fc620/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:51.134364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd377a5-2797-437e-92a5-e6acca13a700 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.136097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd377a5-2797-437e-92a5-e6acca13a700 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.136535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd377a5-2797-437e-92a5-e6acca13a700 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.139013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 786/1578] 10.222.0.76 () {54 vars in 912 bytes} [Thu Oct 28 08:39:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:51.139619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd377a5-2797-437e-92a5-e6acca13a700 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.146954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ad9f85dc-210d-4551-9739-9eb4f5feeac6 None None] MFA Rules not processed for user `f4ad4c2fe0af473d8aea89e1c7e90842`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.151193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ad9f85dc-210d-4551-9739-9eb4f5feeac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.305024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd377a5-2797-437e-92a5-e6acca13a700 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.318886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.319916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.320236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.321542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.322312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.323984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.333848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 793/1579] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.335442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.335740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.336048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.366209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 787/1580] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:51 2021] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:51.366209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.382552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.383815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.500160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad49f7d-c779-40aa-b11c-54830ccdba9f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.504926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.505594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.505885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.506164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.518340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 794/1581] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.519389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.526300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.528928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.531466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b845cf8-1f14-4860-9ba3-c6ed5f55f166 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.538988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.539920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.540548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.541320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] PATH_INFO: `/v3/projects/480e8875b51a460bbbaaa0832f73e1b5/users/4db14bfab8ff426b9997c8025e7fc620/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.545745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] RBAC: Authorizing `identity:create_grant(project_id=480e8875b51a460bbbaaa0832f73e1b5, user_id=4db14bfab8ff426b9997c8025e7fc620, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.549684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5bc50-2e77-4ee7-b098-38e5e6f6459a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.554971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 788/1582] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:51 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:51.555862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.567301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 795/1583] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:51 2021] PUT /identity/v3/projects/480e8875b51a460bbbaaa0832f73e1b5/users/4db14bfab8ff426b9997c8025e7fc620/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:51.572008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6166330-d6a6-4061-a39a-9f0c4de2af83 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.572544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6166330-d6a6-4061-a39a-9f0c4de2af83 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.572828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6166330-d6a6-4061-a39a-9f0c4de2af83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.576633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574dc2-91a0-4f43-8ea5-bd2ed1420668 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.624666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f6166330-d6a6-4061-a39a-9f0c4de2af83 None None] MFA Rules not processed for user `b4e000da3af24420a5d27011dc2fb95a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.627409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f6166330-d6a6-4061-a39a-9f0c4de2af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.688382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.689617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.691940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.692096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.724823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 796/1584] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.726757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309413c-dbe4-4fb7-b066-814a0fc442d3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.727112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309413c-dbe4-4fb7-b066-814a0fc442d3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.727665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309413c-dbe4-4fb7-b066-814a0fc442d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.761999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a309413c-dbe4-4fb7-b066-814a0fc442d3 None None] MFA Rules not processed for user `4db14bfab8ff426b9997c8025e7fc620`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.763375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a309413c-dbe4-4fb7-b066-814a0fc442d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.864891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 797/1585] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.866227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd912-f0a7-461f-ad91-e853720fd6c1 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.866541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd912-f0a7-461f-ad91-e853720fd6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.866832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bd912-f0a7-461f-ad91-e853720fd6c1 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.869662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 798/1586] 10.222.0.76 () {54 vars in 912 bytes} [Thu Oct 28 08:39:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:51.871130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f209e-fc4a-4ee9-9070-ba964660164d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.871850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f209e-fc4a-4ee9-9070-ba964660164d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.871850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f209e-fc4a-4ee9-9070-ba964660164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.879309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.880777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:51.899849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cb0f209e-fc4a-4ee9-9070-ba964660164d None None] MFA Rules not processed for user `b4e000da3af24420a5d27011dc2fb95a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.901330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cb0f209e-fc4a-4ee9-9070-ba964660164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.910108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 799/1587] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.911726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.912019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.912296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.933463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:51.934744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:51.941491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 789/1588] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:51.945332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.951743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 800/1589] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:39:51 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:51.952671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:51.966086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dfc1e-5e35-45d0-88f1-7f5e8856182d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:51.972096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:51.973000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:51.973285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:51.973560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:51.993982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:51.995471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:52.017717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 801/1590] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:51 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:52.020363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:52.022760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:52.102596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659f3c-5117-42c6-9550-1aba14cd5a90 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:52.104685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a94d1-bacd-4aff-85f1-b14a81c6d770 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:52.113959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:52.115196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:52.115480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:52.115618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:52.115759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] PATH_INFO: `/v3/users/cead6ffa9c3c4549a9c13333626ac71c` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:52.116198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:52.116484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:52.116763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:52.119437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cead6ffa9c3c4549a9c13333626ac71c)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:52.120619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: WARNING py.warnings [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:39:52.120619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: warnings.warn(msg) Oct 28 08:39:52.120619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: Oct 28 08:39:52.121975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:52.136329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:52.137825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:52.151200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 802/1591] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:52.176678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:52.187975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163ed0-915e-4d19-a79b-c0cea3eb42cc service glance] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:52.194181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:52.195260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:52.195823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:52.196323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:52.283128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cead6ffa9c3c4549a9c13333626ac71c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:52.284143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cead6ffa9c3c4549a9c13333626ac71c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:52.291953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:52.293488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c684-a1bd-4219-9693-59b560473774 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:52.302928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cead6ffa9c3c4549a9c13333626ac71c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:52.308696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 803/1592] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:52 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:39:52.341517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cead6ffa9c3c4549a9c13333626ac71c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:52.360212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cead6ffa9c3c4549a9c13333626ac71c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:52.373542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 790/1593] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:39:51 2021] DELETE /identity/v3/users/cead6ffa9c3c4549a9c13333626ac71c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:52.379334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:52.381024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:52.381568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:52.406595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:52.416149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:52.560112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 804/1594] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:52.584549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:52.586273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:52.692928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bebe52-ada3-434a-b233-dfe9946ce4df admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:52.708425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:52.708425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:52.708425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:52.708425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:52.741409 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:52.743143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db0903-7c82-411d-9de9-ff5da9f5cca0 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:52.755818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 791/1595] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:52.936243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:52.938003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:53.046268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f7c9-fad6-4bbe-a298-c081a37158a0 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.046588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f7c9-fad6-4bbe-a298-c081a37158a0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.046868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f7c9-fad6-4bbe-a298-c081a37158a0 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:53.052210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 792/1596] 10.222.0.76 () {54 vars in 912 bytes} [Thu Oct 28 08:39:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:39:53.058530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.059216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.059504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:53.133329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52294a-44d4-452b-abd5-84b349ad9503 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:53.147402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:53.149798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:53.150471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.150807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.150965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:53.151086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:53.157139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:53.172120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 793/1597] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:39:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:39:53.199000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:53.200511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:53.243349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:53.244923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a449b6-4aad-4931-9298-f18870a7f877 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:53.245247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412644d8-4d80-4e5a-82a5-c24ba7adcca5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:53.260031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 805/1598] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:52 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:53.263177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:53.263866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.264319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.264596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:53.279806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:53.281428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9632-d5b0-4bd1-be3c-e69e2b8575f9 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:53.303375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 794/1599] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:53 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:39:53.969902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2a99-000a-442c-ab6d-c3c32eb76cd6 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.971022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2a99-000a-442c-ab6d-c3c32eb76cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.971022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2a99-000a-442c-ab6d-c3c32eb76cd6 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:53.973162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 806/1600] 10.222.0.76 () {54 vars in 912 bytes} [Thu Oct 28 08:39:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:53.988883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:53.989498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:53.989498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.038732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:54.040021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:54.057287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 795/1601] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:39:53 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:54.109509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2a99-000a-442c-ab6d-c3c32eb76cd6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:54.133078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2a99-000a-442c-ab6d-c3c32eb76cd6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:54.138050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:54.138892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.143733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.144901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.157704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:54.159196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:54.160016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:54.161901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e2e9d-a5e8-44f4-9f3a-9e884ec88107 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:54.173888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 807/1602] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:54 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:54.196510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3893e-a753-41a8-8262-702ac70e92c5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:54.222429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:54.223457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.223751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.224531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] PATH_INFO: `/v3/projects/6fca104eab6c4383a987eba03d994d4a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.227713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fca104eab6c4383a987eba03d994d4a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:54.232917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:54.380226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576306c7-6301-4b18-b6ac-dcf1b0828ece None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.380691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576306c7-6301-4b18-b6ac-dcf1b0828ece None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.381121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576306c7-6301-4b18-b6ac-dcf1b0828ece None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.383293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 808/1603] 10.222.0.76 () {54 vars in 960 bytes} [Thu Oct 28 08:39:54 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:39:54.396499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.396950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.397507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.449185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fca104eab6c4383a987eba03d994d4a', 'request_id': 'req-967d5ab8-1661-4810-b251-3a3667e5a166'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.462929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] MFA Rules not processed for user `f4a2cc4165da43ac97a20b324eb1d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:54.467955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:54.476393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fca104eab6c4383a987eba03d994d4a', 'request_id': 'req-967d5ab8-1661-4810-b251-3a3667e5a166'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.505417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fca104eab6c4383a987eba03d994d4a', 'request_id': 'req-967d5ab8-1661-4810-b251-3a3667e5a166'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.546622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] The token cache is being invalidate because project 6fca104eab6c4383a987eba03d994d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:39:54.546622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.549392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.562881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 796/1604] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:39:54 2021] DELETE /identity/v3/projects/6fca104eab6c4383a987eba03d994d4a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:39:54.567075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:54.575362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:54.787199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 809/1605] 10.222.0.76 () {58 vars in 1057 bytes} [Thu Oct 28 08:39:54 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:54.797253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:54.821777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f873c6-ec35-4549-9646-58acf10ddfa5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:54.843483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:54.844168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.844456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.845408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.851968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:54.856271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5ab8-1661-4810-b251-3a3667e5a166 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:54.879875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:54.880786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:54.883944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:54.884700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] PATH_INFO: `/v3/users/f4ad4c2fe0af473d8aea89e1c7e90842` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:54.886236 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:54.887901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:54.892437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ad4c2fe0af473d8aea89e1c7e90842)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:54.894688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:54.918540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 810/1606] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:54 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:54.983468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ad4c2fe0af473d8aea89e1c7e90842'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:54.985403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ad4c2fe0af473d8aea89e1c7e90842'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:55.006293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ad4c2fe0af473d8aea89e1c7e90842'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:55.042998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ad4c2fe0af473d8aea89e1c7e90842'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:55.054949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ffb4da37-b064-47df-ab19-a9907ef699c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ad4c2fe0af473d8aea89e1c7e90842'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:55.066759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 797/1607] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:39:54 2021] DELETE /identity/v3/users/f4ad4c2fe0af473d8aea89e1c7e90842 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:56.544469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:56.564215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fe6d-cae3-483b-8063-5f683a2e47a1 service placement] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:56.707186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:56.709778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:56.710188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:56.710735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] PATH_INFO: `/v3/projects/948d99d4e42f483e9a2a250591092c8c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:56.712622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=948d99d4e42f483e9a2a250591092c8c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:56.713964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: WARNING py.warnings [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 08:39:56.713964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: warnings.warn(msg) Oct 28 08:39:56.713964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: Oct 28 08:39:56.715297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:56.800848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948d99d4e42f483e9a2a250591092c8c', 'request_id': 'req-75fcb13d-de01-4b7a-b314-4e8910b03e1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:56.820602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948d99d4e42f483e9a2a250591092c8c', 'request_id': 'req-75fcb13d-de01-4b7a-b314-4e8910b03e1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:56.856299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948d99d4e42f483e9a2a250591092c8c', 'request_id': 'req-75fcb13d-de01-4b7a-b314-4e8910b03e1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:56.880714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] The token cache is being invalidate because project 948d99d4e42f483e9a2a250591092c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:39:56.881950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:56.883152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-75fcb13d-de01-4b7a-b314-4e8910b03e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:56.886843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 811/1608] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:39:56 2021] DELETE /identity/v3/projects/948d99d4e42f483e9a2a250591092c8c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:56.894207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:56.895279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:56.895725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:56.917998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:56.920254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:57.067879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 798/1609] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:57.076190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.084505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.085047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.121764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:57.123098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:57.135659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 812/1610] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:57.140153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.154306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b7660-cdff-4219-b91f-43f4dd7d0799 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.161539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.162545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.163078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.163586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.164977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:39:57.165707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.167722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.208383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 799/1611] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:39:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:39:57.213615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.227401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5b4e8-aec3-4c3f-b8fd-5317d965ec58 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.234114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.234859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.234859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.235421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.236820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.238980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.287249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 813/1612] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:57 2021] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:39:57.293318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.307781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0757-8554-4908-8576-48bd3f47d06a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.468413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.469421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.470430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.470881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.471854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.474021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.523502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 800/1613] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:57 2021] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:57.527703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.543063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ccd51-1b22-4c72-97ff-94089dde1daa admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.559809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.560719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.561202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.561591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.562668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.566870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.603260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 814/1614] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:57 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:57.607351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.636213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75778c3-63fa-4f37-af2f-0f543c4338bf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.658641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.661615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.661951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.662237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.680869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.683198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e92a7-8eb7-427b-ae32-ec2616710fbd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.705110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 801/1615] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:57 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:57.712072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:57.732379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f376-fa4c-4185-adbf-07464a905550 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:57.746902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:57.748492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.749681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.750793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] PATH_INFO: `/v3/projects/9f776bfade1c4227a8d92b96ac189633/users/3688314ca0d84ca8a00875ae78ef49df/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.790586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f776bfade1c4227a8d92b96ac189633, user_id=3688314ca0d84ca8a00875ae78ef49df, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:57.795807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:57.830430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 815/1616] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:57 2021] PUT /identity/v3/projects/9f776bfade1c4227a8d92b96ac189633/users/3688314ca0d84ca8a00875ae78ef49df/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:39:57.841957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:57.842403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:57.843027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:57.917438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] MFA Rules not processed for user `3688314ca0d84ca8a00875ae78ef49df`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:57.919971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:58.026459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 802/1617] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:58.030380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.173354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e92-bb05-42be-957d-0971f9fed941 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.192136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.193130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.193593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.193879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.197660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.201276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.237424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 816/1618] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:39:58 2021] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:58.243564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.258656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b62bea-4727-4d6c-a53f-e9ced8474c8b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.340606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.341396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.341750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.342098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.342947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.346336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.379453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.392003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02c453-6289-4587-acf6-d63a138ed2b9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.392684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 803/1619] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:39:58 2021] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:39:58.398529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.399360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.399755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.400195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.401109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.403477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.422024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.432907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 817/1620] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:58.434308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061964d-051e-4277-9dc4-ba0bd7341c85 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.440214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.441627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.442026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.442413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] PATH_INFO: `/v3/projects/2dd8297a48054941b02b276a9f2dffe6/users/a9084fbf32804577897e9de737d8743e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.459826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd8297a48054941b02b276a9f2dffe6, user_id=a9084fbf32804577897e9de737d8743e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.463181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.484631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 804/1621] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:58 2021] PUT /identity/v3/projects/2dd8297a48054941b02b276a9f2dffe6/users/a9084fbf32804577897e9de737d8743e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:58.489984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.504484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328649c-6d79-44f3-9f38-e0f3214c4ca5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.583046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.584119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.584678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.585130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.586022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.590956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd25eda-bfda-4469-a906-530644e8da57 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.615076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 818/1622] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:39:58.617940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.630565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc1ae-5217-4874-ab94-5b728fbd33f9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.636455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.639807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.639807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.640379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] PATH_INFO: `/v3/projects/2dd8297a48054941b02b276a9f2dffe6/users/a9084fbf32804577897e9de737d8743e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.644540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd8297a48054941b02b276a9f2dffe6, user_id=a9084fbf32804577897e9de737d8743e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.664005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:58.683422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 805/1623] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:39:58 2021] PUT /identity/v3/projects/2dd8297a48054941b02b276a9f2dffe6/users/a9084fbf32804577897e9de737d8743e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:58.748981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.749379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.749913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.799273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] MFA Rules not processed for user `a9084fbf32804577897e9de737d8743e`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:58.800505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:58.898836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:58.899296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 819/1624] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:58 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:39:58.900828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:58.979249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5392f-bc45-4d75-be76-8b39b255189c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:58.983793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:58.985118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:58.985810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:58.986116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:58.998001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:58.999882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4be97e-d426-46d2-9e84-7d3d26415ced service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:59.014531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 806/1625] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:39:58 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:39:59.065170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:39:59.264128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51258bf-d2a4-420b-bf8e-b392567e78e6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:39:59.283190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:39:59.284397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:59.284518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:59.284777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] PATH_INFO: `/v3/users/3688314ca0d84ca8a00875ae78ef49df` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:59.286010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3688314ca0d84ca8a00875ae78ef49df)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:39:59.288214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:39:59.393683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3688314ca0d84ca8a00875ae78ef49df'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:59.394723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3688314ca0d84ca8a00875ae78ef49df'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:59.395548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3688314ca0d84ca8a00875ae78ef49df'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:59.422421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3688314ca0d84ca8a00875ae78ef49df'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:59.440041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3688314ca0d84ca8a00875ae78ef49df'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:39:59.463193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 820/1626] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:39:59 2021] DELETE /identity/v3/users/3688314ca0d84ca8a00875ae78ef49df => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:39:59.467307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa625-58f6-478b-bf50-cc8a7ef95855 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:39:59.467664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa625-58f6-478b-bf50-cc8a7ef95855 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:39:59.467891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fa625-58f6-478b-bf50-cc8a7ef95855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:39:59.507843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1a9fa625-58f6-478b-bf50-cc8a7ef95855 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:39:59.509171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1a9fa625-58f6-478b-bf50-cc8a7ef95855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:39:59.636689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 807/1627] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:39:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:00.019160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:00.021308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:00.175274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c56be8-93fd-4125-934c-4b7cd9b929f6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:00.204895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:00.204895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:00.204895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:00.204895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:00.226291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:00.227833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c77cf-a5d4-4655-a602-b849dd96bc7d service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:00.251450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 821/1628] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:00.518006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:00.518615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:00.522368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:00.605665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] MFA Rules not processed for user `aaeb0fe842e54e3b9f0750069d83231c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:00.607200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:00.724768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 808/1629] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:00 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:00.740884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:00.744017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:00.744348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:00.774656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] MFA Rules not processed for user `aaeb0fe842e54e3b9f0750069d83231c`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:00.776684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:00.787265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 822/1630] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:00 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:00.801503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:00.803864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:00.962491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef7d3-669c-44c2-a4cc-1c2cc429cef7 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:00.979408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:00.980100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:00.980390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:00.980672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:01.015537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:01.020973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:01.065960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 809/1631] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:00 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:01.103981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:01.110478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:01.146452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb53a9-5136-498d-98b4-fc76a97bcfeb None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:01.153770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:01.155021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:01.156006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:01.156513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] PATH_INFO: `/v3/projects/9f776bfade1c4227a8d92b96ac189633` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:01.158452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f776bfade1c4227a8d92b96ac189633)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:01.160778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:01.249270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f776bfade1c4227a8d92b96ac189633', 'request_id': 'req-9e8cf854-7f53-408c-989d-7fc9cc2fd087'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.257690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f776bfade1c4227a8d92b96ac189633', 'request_id': 'req-9e8cf854-7f53-408c-989d-7fc9cc2fd087'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.265422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f776bfade1c4227a8d92b96ac189633', 'request_id': 'req-9e8cf854-7f53-408c-989d-7fc9cc2fd087'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.291541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] The token cache is being invalidate because project 9f776bfade1c4227a8d92b96ac189633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:01.291842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.295445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.297548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 823/1632] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:01 2021] DELETE /identity/v3/projects/9f776bfade1c4227a8d92b96ac189633 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:01.301766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:01.319087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86679-78d4-4610-b073-4fcd637b8918 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:01.474874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:01.476014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:01.476295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:01.476566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] PATH_INFO: `/v3/users/a9084fbf32804577897e9de737d8743e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:01.478232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9084fbf32804577897e9de737d8743e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:01.480778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:01.554879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9084fbf32804577897e9de737d8743e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.555898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9084fbf32804577897e9de737d8743e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.565432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9084fbf32804577897e9de737d8743e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.581105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9084fbf32804577897e9de737d8743e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.591169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1b432d32-b40c-454c-8b15-ca1a7b82055e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9084fbf32804577897e9de737d8743e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:01.604670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 810/1633] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:01 2021] DELETE /identity/v3/users/a9084fbf32804577897e9de737d8743e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:02.255891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:02.257602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:02.286577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cf854-7f53-408c-989d-7fc9cc2fd087 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:02.414294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:02.415437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.415929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.416441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] PATH_INFO: `/v3/projects/2dd8297a48054941b02b276a9f2dffe6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.417933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd8297a48054941b02b276a9f2dffe6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:02.443021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:02.529863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd8297a48054941b02b276a9f2dffe6', 'request_id': 'req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:02.539615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd8297a48054941b02b276a9f2dffe6', 'request_id': 'req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:02.546329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd8297a48054941b02b276a9f2dffe6', 'request_id': 'req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:02.570426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] The token cache is being invalidate because project 2dd8297a48054941b02b276a9f2dffe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:02.570709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:02.571348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-bb61bbc3-03e5-4f0b-b217-8a86e55ee594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:02.574104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 824/1634] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:02 2021] DELETE /identity/v3/projects/2dd8297a48054941b02b276a9f2dffe6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:02.582347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541075a-0227-4c61-a059-2f82aece2351 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.585192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541075a-0227-4c61-a059-2f82aece2351 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.586450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541075a-0227-4c61-a059-2f82aece2351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.630852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f541075a-0227-4c61-a059-2f82aece2351 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:02.632708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f541075a-0227-4c61-a059-2f82aece2351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:02.715870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.716782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.717160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.725970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 811/1635] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:02.730447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.730892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.731125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.763129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] MFA Rules not processed for user `483af16bae1f4521ad3e3138bbc86123`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:02.764614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:02.773292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:02.778441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:02.796351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 812/1636] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:02.797519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:02.810670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96000c-469c-4eb5-b471-473015b48c26 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:02.818260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:02.819687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.820148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.820593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.821604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:02.822091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:02.823946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:02.858262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 813/1637] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:02.863770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:02.877320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695475a-538d-48fb-b5a6-984597c53d7c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:02.877684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 825/1638] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:02 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:02.886993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:02.887690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:02.887983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:02.888258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:02.889257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:02.891711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:02.947624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 814/1639] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:02 2021] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:02.948295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:02.961813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db656612-fc68-4a96-967f-de9137b0c23b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:02.971640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:02.974211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:03.119049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.120030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.120535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.120984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.122454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.125062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:03.147997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bf16-3767-4714-bbbb-34676b7a6659 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:03.158309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.158726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.159198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.159642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.174445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 826/1640] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:02 2021] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:03.176452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:03.202097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9014ed-4a45-421a-8e9f-8e970fd72804 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:03.215667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.216481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.217401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.217656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.218882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.221218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:03.238447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 827/1641] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:03.239446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:03.251938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c0d79-e52c-4102-ada6-a28bd509dbf3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:03.279395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.280111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.280343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.280843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.282603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.284988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:03.302166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 828/1642] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:03.309811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:03.320765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.322370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12403f2-12c1-46bb-bd78-721f52287dd9 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:03.322660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce116b-7bb9-4523-8351-88ef744aa412 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:03.330461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.332504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.333004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.333496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] PATH_INFO: `/v3/projects/613c9385a8d14defbcf9340764ad5571/users/a5d8f8bdddcf49a7af0ea91cff211b6c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.342582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 815/1643] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:02 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:03.362432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=613c9385a8d14defbcf9340764ad5571, user_id=a5d8f8bdddcf49a7af0ea91cff211b6c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.380887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:03.432432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 829/1644] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:03 2021] PUT /identity/v3/projects/613c9385a8d14defbcf9340764ad5571/users/a5d8f8bdddcf49a7af0ea91cff211b6c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:03.432651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369624-e768-4c28-adca-5a5d3a71fe88 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.432947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369624-e768-4c28-adca-5a5d3a71fe88 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.433230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369624-e768-4c28-adca-5a5d3a71fe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.518891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9a369624-e768-4c28-adca-5a5d3a71fe88 None None] MFA Rules not processed for user `a5d8f8bdddcf49a7af0ea91cff211b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:03.524353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9a369624-e768-4c28-adca-5a5d3a71fe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:03.681430 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 816/1645] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:03 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:03.685940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:03.782644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.783181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.783469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.835612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] MFA Rules not processed for user `aaeb0fe842e54e3b9f0750069d83231c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:03.838948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:03.882846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9443d1-c91f-45e2-8101-f887dafda5ee admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:03.917207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:03.923057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:03.923315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:03.923590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:03.939212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:03.944621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.033887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 830/1646] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:03 2021] POST /identity/v3/projects => generated 365 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:04.042874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.043408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 817/1647] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:03 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:04.164465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a900f-9cd4-45bd-a0a7-20a8c1c046fe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:04.171721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:04.172700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.173169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.173671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.174789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:04.179033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.222828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 831/1648] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:04 2021] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:04.227380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.242265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86a468-6d31-4ec3-88d7-8a144ad105ae None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:04.250097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:04.250765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.251075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.251356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.252123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:04.253759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.265160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 818/1649] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:04 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:04.270011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.284287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19681e-5d58-4892-9803-e9dc582c7630 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:04.301017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:04.302038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.302392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.302781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] PATH_INFO: `/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b/users/b9bb545c4af149e8941440dcbfb9b8a3/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.322450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=165d0935c94c4a9fa488dd20a1f4d67b, user_id=b9bb545c4af149e8941440dcbfb9b8a3, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:04.327102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.349418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 832/1650] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:04 2021] PUT /identity/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b/users/b9bb545c4af149e8941440dcbfb9b8a3/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:04.354259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.378930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e94cba-109d-4967-b4b7-78d0ba6c8c89 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:04.518153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:04.518153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.518153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.518153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.521313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:04.528168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dc89f-7b94-4b88-884f-139d690f630f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.541011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 819/1651] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:04 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:04.546776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.559155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983fb38-4b96-4b7b-8bd5-9983f7592b2e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:04.564990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:04.568240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.568240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.568240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] PATH_INFO: `/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b/users/b9bb545c4af149e8941440dcbfb9b8a3/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.569100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165d0935c94c4a9fa488dd20a1f4d67b, user_id=b9bb545c4af149e8941440dcbfb9b8a3, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:04.587503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7728b4-3c4a-476d-b59d-057399ac9379 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:04.615141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 833/1652] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:04 2021] PUT /identity/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b/users/b9bb545c4af149e8941440dcbfb9b8a3/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:04.627217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.627363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.628004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.638321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:04.638895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:04.639333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:04.717632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] MFA Rules not processed for user `b9bb545c4af149e8941440dcbfb9b8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:04.721018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] MFA Rules not processed for user `a8a8c3c685aa49499037c493b1b99eed`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:04.724879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:04.726599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:04.908486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 834/1653] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:04 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:04.971898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 820/1654] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:04 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:04.985624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:04.987546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:05.113130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc596b-ffd4-4b07-b890-e7c09ce538fc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:05.117387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:05.118061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:05.118348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:05.118687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:05.155116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:05.162759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:05.164269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13517-59cd-4847-918b-23bc2be4cb93 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:05.195498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 835/1655] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:04 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:05.215052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:05.215337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:05.215625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:05.261715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:05.267367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:05.286296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de447-867d-4dd1-8673-8110b5115b2c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:05.299051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:05.299978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:05.300270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:05.300551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:05.314471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:05.320215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:05.368657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 821/1656] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:05 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:05.462416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:05.475750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 836/1657] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:40:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:05.493752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594f24-dd75-44b8-a084-bdee1d429779 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:05.506014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:05.506744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:05.507229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:05.507653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:05.652357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:05.654167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:05.674271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 822/1658] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:05 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:05.841764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:05.843432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:06.139783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9b030-69f0-4c3a-81fc-cbfe90a71c0c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:06.175410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:06.176322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:06.177904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:06.178366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:06.217988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:06.223901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8efea-f56a-49d8-afa2-2008477a8f2b service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:06.289392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 837/1659] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:40:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:40:08.474156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:08.477067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:08.746271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e972d-339c-4757-afd5-4ed005a455f7 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:08.769771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:08.771052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:08.771495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:08.771920 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] PATH_INFO: `/v3/users/7e504cc0e7f44b0184eefe6950d7af3b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:08.773410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e504cc0e7f44b0184eefe6950d7af3b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:08.776576 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:08.929871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e504cc0e7f44b0184eefe6950d7af3b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:08.932802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e504cc0e7f44b0184eefe6950d7af3b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:08.963909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e504cc0e7f44b0184eefe6950d7af3b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:09.013756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e504cc0e7f44b0184eefe6950d7af3b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:09.034643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b2842bd7-b9a2-49ed-84fa-556556dc7c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e504cc0e7f44b0184eefe6950d7af3b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:09.054960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 823/1660] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:08 2021] DELETE /identity/v3/users/7e504cc0e7f44b0184eefe6950d7af3b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:09.059580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650659-5db4-485f-b532-949767b63535 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:09.060421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:09.061345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650659-5db4-485f-b532-949767b63535 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:09.061801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:09.062238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650659-5db4-485f-b532-949767b63535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:09.062690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:09.125268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:09.128247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-5d650659-5db4-485f-b532-949767b63535 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:09.129734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5d650659-5db4-485f-b532-949767b63535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:09.146464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:09.270348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 838/1661] 10.222.0.70 () {58 vars in 1015 bytes} [Thu Oct 28 08:40:09 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:09.310643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 824/1662] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:09.314907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:09.316348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:09.330340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eed11-f317-4dbc-b9cd-52d31efa8c86 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:09.349917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650659-5db4-485f-b532-949767b63535 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:09.359192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:09.360776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:09.361982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:09.363647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:09.370058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650659-5db4-485f-b532-949767b63535 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:09.400866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:09.401407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:09.401692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:09.401967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:09.403442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:09.404918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:09.430531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:09.431980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:09.437122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 839/1663] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:09.438626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:09.473632 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9b2eb-d44a-4636-9cc4-61220019aa39 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:09.474320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 825/1664] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:09.484417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:09.485917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:09.486354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:09.486810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:09.505156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:09.506860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d0cf4-bb58-42e2-9e18-5ced99400039 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:09.529387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 840/1665] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:13.061380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:13.063594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:13.124076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8af3f-81f2-4ab0-9d36-1c454279da6d service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:13.138802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:13.140020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.140503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.140969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] PATH_INFO: `/v3/projects/b13cff8b20714a9da7bb1c6e6749bfb0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.146812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13cff8b20714a9da7bb1c6e6749bfb0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:13.149016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:13.178630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78df2-a982-4d08-9aaa-3961049c380c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.179272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78df2-a982-4d08-9aaa-3961049c380c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.179272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78df2-a982-4d08-9aaa-3961049c380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.218717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b1e78df2-a982-4d08-9aaa-3961049c380c None None] MFA Rules not processed for user `483af16bae1f4521ad3e3138bbc86123`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:13.233578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b1e78df2-a982-4d08-9aaa-3961049c380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:13.341388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13cff8b20714a9da7bb1c6e6749bfb0', 'request_id': 'req-c8e9c193-d913-4378-ae63-df2cff87d931'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:13.372131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13cff8b20714a9da7bb1c6e6749bfb0', 'request_id': 'req-c8e9c193-d913-4378-ae63-df2cff87d931'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:13.404535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13cff8b20714a9da7bb1c6e6749bfb0', 'request_id': 'req-c8e9c193-d913-4378-ae63-df2cff87d931'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:13.414648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 841/1666] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:13 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:13.481263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] The token cache is being invalidate because project b13cff8b20714a9da7bb1c6e6749bfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:13.481263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:13.481263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c8e9c193-d913-4378-ae63-df2cff87d931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:13.484187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 826/1667] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:13 2021] DELETE /identity/v3/projects/b13cff8b20714a9da7bb1c6e6749bfb0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:13.489977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.490267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.490756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.539776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:13.541405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:13.699543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 842/1668] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:13.700752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.701025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.701312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.756706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:13.759795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:13.787659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 827/1669] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:13.789302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:13.802453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891fac-cca4-4256-9650-c94f23cbe296 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:13.837826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:13.838613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.838904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.839184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.839957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:13.840264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:13.841909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:13.888870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 843/1670] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:13.889429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:13.904670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e947b-1f4e-441e-a546-762af5147630 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:13.924665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:13.948663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:13.948663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:13.948663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:13.948663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:13.948663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.036675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.038446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:14.063638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 828/1671] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:13 2021] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:14.064707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.072106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb77c8-df9e-46a1-adbc-032a8d9602e3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.292078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:14.296303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.297731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.298667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] PATH_INFO: `/v3/users/a5d8f8bdddcf49a7af0ea91cff211b6c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.301668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d8f8bdddcf49a7af0ea91cff211b6c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:14.308418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.380472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff645f-6f7b-452c-ada9-5e76de3efd91 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.410868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:14.416641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.416953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.417244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.418403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d8f8bdddcf49a7af0ea91cff211b6c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:14.423146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:14.424846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d8f8bdddcf49a7af0ea91cff211b6c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:14.428394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d8f8bdddcf49a7af0ea91cff211b6c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:14.437356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.461093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d8f8bdddcf49a7af0ea91cff211b6c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:14.483819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-913ac552-7e00-4832-877c-91647eb01bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d8f8bdddcf49a7af0ea91cff211b6c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:14.493232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 829/1672] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:14 2021] POST /identity/v3/users => generated 287 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:14.494538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.499187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:14.530152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c043f-69ea-4656-843e-5ca12cfd4d06 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.538932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 844/1673] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:14 2021] DELETE /identity/v3/users/a5d8f8bdddcf49a7af0ea91cff211b6c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:14.546187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.546513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.546801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.593722 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:14.595993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:14.699953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:14.700882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.701170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.701534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.703233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:14.707804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.737347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 830/1674] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:14 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:14.740996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.765761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af7727-42d2-42fc-8bcc-736a1c3173dc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.768806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 845/1675] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:14.779641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:14.780376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.780666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.780945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.781743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:14.783408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.808996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 831/1676] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:14 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:14.810262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.824333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:14.826285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:14.827364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1f9d-be27-497d-beed-2d587ac10b03 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.849773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:14.851098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.851510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.851901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] PATH_INFO: `/v3/projects/7865be4ed484454bbc80639993787725/users/e7bcfc063dd946eead8448e6ca4f61d0/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:14.904065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7865be4ed484454bbc80639993787725, user_id=e7bcfc063dd946eead8448e6ca4f61d0, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:14.907600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982c8c-1ae4-4c30-a33d-0450e5754508 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:14.952709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 846/1677] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:14 2021] PUT /identity/v3/projects/7865be4ed484454bbc80639993787725/users/e7bcfc063dd946eead8448e6ca4f61d0/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:14.954655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91a04-d6c0-40a6-9741-ffed79aa89bc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:14.955755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91a04-d6c0-40a6-9741-ffed79aa89bc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:14.957573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111c6be-dce7-46c1-afe5-cb84fed671a0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:14.958045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91a04-d6c0-40a6-9741-ffed79aa89bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:15.023922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-38c91a04-d6c0-40a6-9741-ffed79aa89bc None None] MFA Rules not processed for user `e7bcfc063dd946eead8448e6ca4f61d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:15.025775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-38c91a04-d6c0-40a6-9741-ffed79aa89bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:15.094521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:15.096998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:15.097487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:15.097908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:15.220176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 847/1678] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:15.228564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91311b0-8d86-49eb-9c6a-9c1214d155f0 None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:15.229002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91311b0-8d86-49eb-9c6a-9c1214d155f0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:15.230858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91311b0-8d86-49eb-9c6a-9c1214d155f0 None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:15.235150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 848/1679] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:40:15 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:40:15.241915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:15.243669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987bcbd-a05e-4c70-b4a9-cd7bd00b1567 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:15.267620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 832/1680] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:15.300969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8feb-69cf-4fa6-ade8-58ad35217880 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:15.301554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8feb-69cf-4fa6-ade8-58ad35217880 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:15.301554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e8feb-69cf-4fa6-ade8-58ad35217880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:15.341650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0d4e8feb-69cf-4fa6-ade8-58ad35217880 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:15.343037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0d4e8feb-69cf-4fa6-ade8-58ad35217880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:15.446733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 849/1681] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:40:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:16.088346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:16.088930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:16.089362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:16.091810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 833/1682] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:40:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:40:16.108515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bba4e-1a82-460b-bb58-2268d15a49a1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:16.108857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bba4e-1a82-460b-bb58-2268d15a49a1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:16.109143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bba4e-1a82-460b-bb58-2268d15a49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:16.144467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3e5bba4e-1a82-460b-bb58-2268d15a49a1 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:16.152985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3e5bba4e-1a82-460b-bb58-2268d15a49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:16.168644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 850/1683] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:40:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:16.659404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:16.661408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:16.700832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da637-a40b-4e5d-8c7d-5d636ec67eaf None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:16.716517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:16.717472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:16.722886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:16.723309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:16.724263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:16.724920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:16.724920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:16.745461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:16.747495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:16.758319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] MFA Rules not processed for user `a8a8c3c685aa49499037c493b1b99eed`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:16.775194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:16.780676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 834/1684] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:16 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:16.796584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:16.803931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:16.842463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab6e9f-c3ef-4f08-99c4-48abb5458eb5 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:16.863735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:16.864664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:16.865063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:16.865452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:16.892330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:16.908218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:16.970703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 835/1685] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:16.990044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 851/1686] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:16 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:17.208559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:17.224323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb5a2a-961d-492f-a258-04fdf04d0b39 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:17.266022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:17.266694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:17.266984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:17.267267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:17.322384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:17.326291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:17.390831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 836/1687] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:17.404246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:17.437521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:17.470932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab1b76-9a8d-4b06-af56-771babd90137 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:17.491868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:17.495128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:17.495433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:17.496389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] PATH_INFO: `/v3/projects/613c9385a8d14defbcf9340764ad5571` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:17.500920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=613c9385a8d14defbcf9340764ad5571)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:17.517226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:17.769272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613c9385a8d14defbcf9340764ad5571', 'request_id': 'req-505b8204-b217-49c4-b574-e29f640bfc0d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:17.826522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613c9385a8d14defbcf9340764ad5571', 'request_id': 'req-505b8204-b217-49c4-b574-e29f640bfc0d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:17.893467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613c9385a8d14defbcf9340764ad5571', 'request_id': 'req-505b8204-b217-49c4-b574-e29f640bfc0d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:17.947904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] The token cache is being invalidate because project 613c9385a8d14defbcf9340764ad5571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:17.948193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:17.959878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:17.975516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 852/1688] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:17 2021] DELETE /identity/v3/projects/613c9385a8d14defbcf9340764ad5571 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:17.976649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:18.005028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80f254-c32a-424b-b577-6fc7e065d999 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:18.194665 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:18.209078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:18.209605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:18.210060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] PATH_INFO: `/v3/users/b9bb545c4af149e8941440dcbfb9b8a3` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:18.211719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bb545c4af149e8941440dcbfb9b8a3)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:18.214284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:18.301365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bb545c4af149e8941440dcbfb9b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:18.302250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bb545c4af149e8941440dcbfb9b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:18.325382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bb545c4af149e8941440dcbfb9b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:18.368448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bb545c4af149e8941440dcbfb9b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:18.396033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac348331-fc47-4878-9486-31dbc6a1159f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bb545c4af149e8941440dcbfb9b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:18.408852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 837/1689] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:17 2021] DELETE /identity/v3/users/b9bb545c4af149e8941440dcbfb9b8a3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:19.058395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:19.059928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:19.112622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b8204-b217-49c4-b574-e29f640bfc0d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:19.236951 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:19.238542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:19.239035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:19.239627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] PATH_INFO: `/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:19.241381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165d0935c94c4a9fa488dd20a1f4d67b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:19.245369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:19.335691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165d0935c94c4a9fa488dd20a1f4d67b', 'request_id': 'req-f13b6a07-e036-406b-9c7d-949e76ee8947'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:19.347824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165d0935c94c4a9fa488dd20a1f4d67b', 'request_id': 'req-f13b6a07-e036-406b-9c7d-949e76ee8947'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:19.361283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165d0935c94c4a9fa488dd20a1f4d67b', 'request_id': 'req-f13b6a07-e036-406b-9c7d-949e76ee8947'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:19.379986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] The token cache is being invalidate because project 165d0935c94c4a9fa488dd20a1f4d67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:19.380683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:19.381420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f13b6a07-e036-406b-9c7d-949e76ee8947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:19.391087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 853/1690] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:19 2021] DELETE /identity/v3/projects/165d0935c94c4a9fa488dd20a1f4d67b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:19.392844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:19.393539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:19.393539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:19.433025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:19.434272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:19.621860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 838/1691] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:19.629666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:19.629912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:19.630216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:19.681916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:19.684397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:19.717761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 854/1692] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:19.721139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:19.757056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2159c9-1c90-4e97-91e3-a4138e2202e4 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:19.791978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:19.793377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:19.795228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:19.796113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:19.800291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:19.801389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:19.805045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:19.839150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 839/1693] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:19.846222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:19.865860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9f41c-14be-4396-88a2-bff99e459ca5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:19.872453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:19.873438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:19.873913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:19.874372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:19.875904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:19.878383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:19.915335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 855/1694] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:19 2021] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:19.918913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:19.934741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e82350-7951-4aba-afc2-f409e48cfe27 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.010778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.011541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.011898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.012182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.013085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.015156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.041966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 840/1695] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:19 2021] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:20.043224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.056700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa547cc1-70ad-4912-9771-605abf5da6d8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.065471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.066602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.067099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.067596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.068564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.071616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.085716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 856/1696] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:20.089956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.101234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f5aa0e-7834-452b-a852-a0fb1990c0f1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.106082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.106815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.107102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.107440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.108193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.110972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480364-6e8a-4419-97d0-a6cc88dc9a3a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.124705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 841/1697] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:20.126996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.137108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ec374-3b01-4bf3-9af1-adcc6d9dc323 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.143523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.144424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.144726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.144983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] PATH_INFO: `/v3/projects/893f8b543d0044fda5b5e9671304fab9/users/1acfb9310f2c4127a5cf104b7ab0bd76/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.162325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=893f8b543d0044fda5b5e9671304fab9, user_id=1acfb9310f2c4127a5cf104b7ab0bd76, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.167991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.218624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.218921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.219445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.220933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 857/1698] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:20 2021] PUT /identity/v3/projects/893f8b543d0044fda5b5e9671304fab9/users/1acfb9310f2c4127a5cf104b7ab0bd76/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:20.259331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] MFA Rules not processed for user `1acfb9310f2c4127a5cf104b7ab0bd76`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:20.261033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:20.385329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.385865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 842/1699] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:20 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:20.470280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b55e2e-eeea-4f69-b5e7-72cae7e6f6af admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.476090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.476969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.477443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.477848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.479096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.481254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.542387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 858/1700] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:20 2021] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:20.546518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.561188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38e4c-76e6-4f25-b0ab-58050d454495 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.648319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.649252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.649623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.650121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.651329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.663898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.727591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 843/1701] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:20 2021] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:20.727981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.742329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c9ecd-1275-4276-bb63-9c16ae33418e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.751867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.752831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.753363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.753844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.754729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.756610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.778098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 859/1702] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:20.779949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.800094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616a10b-915b-43b3-bbf6-852c8a562b34 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.808503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.811061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.811630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.812082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] PATH_INFO: `/v3/projects/8c638d9bdca544a5bf19335c06b141d1/users/93c88ee090344537abb47bfb2264efde/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.837323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c638d9bdca544a5bf19335c06b141d1, user_id=93c88ee090344537abb47bfb2264efde, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.840297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.865114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 844/1703] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:20 2021] PUT /identity/v3/projects/8c638d9bdca544a5bf19335c06b141d1/users/93c88ee090344537abb47bfb2264efde/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:20.871423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.883208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a9f61-39f6-4b71-bd57-04a585fb5470 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.945271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.945941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.946226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.946598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.947356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.948988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c122596-7f3a-4807-b80e-f83da9caa504 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.959294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 860/1704] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:20 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:20.963679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:20.974228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a97d-fb2c-4cbb-ad07-7e8599b8325a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:20.979411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:20.980366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:20.980626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:20.980898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] PATH_INFO: `/v3/projects/8c638d9bdca544a5bf19335c06b141d1/users/93c88ee090344537abb47bfb2264efde/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:20.982968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c638d9bdca544a5bf19335c06b141d1, user_id=93c88ee090344537abb47bfb2264efde, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:20.985671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:20.995999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 845/1705] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:20 2021] PUT /identity/v3/projects/8c638d9bdca544a5bf19335c06b141d1/users/93c88ee090344537abb47bfb2264efde/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:21.006441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.006709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.006990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.036935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] MFA Rules not processed for user `93c88ee090344537abb47bfb2264efde`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:21.038258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:21.113738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 861/1706] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:21 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:21.124093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:21.126577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:21.197126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42fc9-fc96-41ea-9999-83943d6139ee admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:21.201138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:21.201799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.202152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.202464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.215317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:21.216948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2077f-24d2-472b-9313-dc1a1a1e5e22 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:21.228314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 846/1707] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:21 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:21.613780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:21.677838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b39e39-7d78-4543-8af9-545ab2be7350 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:21.682420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:21.683395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.683684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.683968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] PATH_INFO: `/v3/users/1acfb9310f2c4127a5cf104b7ab0bd76` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.685199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acfb9310f2c4127a5cf104b7ab0bd76)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:21.687357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:21.740095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acfb9310f2c4127a5cf104b7ab0bd76'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:21.740790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acfb9310f2c4127a5cf104b7ab0bd76'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:21.741467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acfb9310f2c4127a5cf104b7ab0bd76'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:21.754745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acfb9310f2c4127a5cf104b7ab0bd76'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:21.767987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acfb9310f2c4127a5cf104b7ab0bd76'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:21.776054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 862/1708] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:21 2021] DELETE /identity/v3/users/1acfb9310f2c4127a5cf104b7ab0bd76 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:21.780489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.780944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.781078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.800748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:21.801978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:21.866439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 847/1709] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:21.876747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:21.878615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:21.944998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876ae4-35f9-4706-a3e0-f9a9d78e11ee admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:21.948891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:21.949545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.949832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.950109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.960997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:21.962616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509996a-ce0a-4a3a-a6f8-7eb8c9a5a690 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:21.968373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:21.971009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:21.973614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 863/1710] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:21.984056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421716a-ff06-42c2-8422-1bf31739a98b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:21.989646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:21.990544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:21.990830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:21.991102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] PATH_INFO: `/v3/users/e7bcfc063dd946eead8448e6ca4f61d0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:21.992316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bcfc063dd946eead8448e6ca4f61d0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:21.994233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:22.048946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bcfc063dd946eead8448e6ca4f61d0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.049631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bcfc063dd946eead8448e6ca4f61d0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.056708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bcfc063dd946eead8448e6ca4f61d0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.068938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bcfc063dd946eead8448e6ca4f61d0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.079531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bcfc063dd946eead8448e6ca4f61d0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.087975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 848/1711] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:21 2021] DELETE /identity/v3/users/e7bcfc063dd946eead8448e6ca4f61d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:22.092614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:22.092909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:22.093198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:22.113653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:22.114914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:22.185679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 864/1712] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:22.197695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:22.199403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:22.263443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:22.264931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:22.277832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3a2d-f6dc-441c-8a0d-483e9723b2e9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:22.282802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:22.283675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:22.283992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:22.284423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:22.292325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02aeb7-3024-4bd5-aeda-b4931ff38cbd None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:22.302737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:22.304299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:22.305420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:22.305534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:22.305723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:22.306317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] PATH_INFO: `/v3/projects/893f8b543d0044fda5b5e9671304fab9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:22.308323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=893f8b543d0044fda5b5e9671304fab9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:22.310366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:22.317722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 849/1713] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:22.375091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893f8b543d0044fda5b5e9671304fab9', 'request_id': 'req-e648e2da-8d30-4449-852f-0599f57a6eee'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.382830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893f8b543d0044fda5b5e9671304fab9', 'request_id': 'req-e648e2da-8d30-4449-852f-0599f57a6eee'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.389660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893f8b543d0044fda5b5e9671304fab9', 'request_id': 'req-e648e2da-8d30-4449-852f-0599f57a6eee'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.408758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] The token cache is being invalidate because project 893f8b543d0044fda5b5e9671304fab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:22.409127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.410635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.412695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 865/1714] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:22 2021] DELETE /identity/v3/projects/893f8b543d0044fda5b5e9671304fab9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:22.416962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:22.428845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532732fd-1a1a-4799-89df-279a1a672abb service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:22.511498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:22.518673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:22.519302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:22.519587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] PATH_INFO: `/v3/users/93c88ee090344537abb47bfb2264efde` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:22.521663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c88ee090344537abb47bfb2264efde)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:22.523918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:22.591373 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c88ee090344537abb47bfb2264efde'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.592020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c88ee090344537abb47bfb2264efde'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.601589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c88ee090344537abb47bfb2264efde'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.617123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c88ee090344537abb47bfb2264efde'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.628177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b2470bb-bd3b-4d99-957f-33e83316a080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c88ee090344537abb47bfb2264efde'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:22.638870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 850/1715] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:22 2021] DELETE /identity/v3/users/93c88ee090344537abb47bfb2264efde => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:22.862560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:22.863417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:22.877733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648e2da-8d30-4449-852f-0599f57a6eee admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:22.961621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:22.962594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:22.962806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:22.963080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] PATH_INFO: `/v3/projects/7865be4ed484454bbc80639993787725` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:22.964454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7865be4ed484454bbc80639993787725)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:22.966373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.029302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7865be4ed484454bbc80639993787725', 'request_id': 'req-643dccd5-cc43-4abd-8757-f21ddd7a9599'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:23.035795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7865be4ed484454bbc80639993787725', 'request_id': 'req-643dccd5-cc43-4abd-8757-f21ddd7a9599'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:23.043427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7865be4ed484454bbc80639993787725', 'request_id': 'req-643dccd5-cc43-4abd-8757-f21ddd7a9599'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:23.058097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] The token cache is being invalidate because project 7865be4ed484454bbc80639993787725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:23.058385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:23.059187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-643dccd5-cc43-4abd-8757-f21ddd7a9599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:23.066587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 866/1716] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:22 2021] DELETE /identity/v3/projects/7865be4ed484454bbc80639993787725 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:23.067390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.067826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.067946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.090685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:23.091926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:23.185943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 851/1717] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:23.196828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.197383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.198065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.257516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:23.259598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:23.273746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 867/1718] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:23.276662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.304953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f6d61-118d-46c5-a349-7e67e85618be None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.315384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.316200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.316944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.316944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.317509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:23.317951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.320158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.335571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 852/1719] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:23.339841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.352916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8814fb-d73c-4784-81d6-a1f212681e1e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.358090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.358799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.359087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.360245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.360852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.362867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.402829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 868/1720] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:23.408284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.420786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27ea09-7c2d-432e-8dbf-6b50e2eef3d9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.494443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.495445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.495736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.496181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.496960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.501782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.533457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.533813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 853/1721] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:23.549033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0bcb5-ea94-4995-a405-3138e4a0a2ba admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.557661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.558409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.558754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.559625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.559930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.561805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.584160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.584625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 869/1722] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:23.595407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec8e3-41ac-4cf3-8cb1-9e019040caf4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.603014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.603014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.603014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.605045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.605853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.607784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b973-0e90-494d-9534-23fc733571c5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.640057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 854/1723] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:23.645372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.660077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8415-b65d-4d2f-bc22-d04b3fe6fb9d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:23.665440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:23.666376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.666897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.667184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] PATH_INFO: `/v3/projects/feb4cd298bb346fbaae4b039de274b52/users/467833f628de45bcb9938512ea823cb4/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.689258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb4cd298bb346fbaae4b039de274b52, user_id=467833f628de45bcb9938512ea823cb4, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:23.693379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:23.730539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 870/1724] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:23 2021] PUT /identity/v3/projects/feb4cd298bb346fbaae4b039de274b52/users/467833f628de45bcb9938512ea823cb4/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:23.769619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:23.770914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:23.771206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:23.804855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] MFA Rules not processed for user `467833f628de45bcb9938512ea823cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:23.806030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:23.882299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 855/1725] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:23.886804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:23.986796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71306d-5051-4943-b1d6-de04b81bbecb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.011050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.013376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.013703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.013982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.018667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.021580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.039729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.041592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:24.066224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e7bb-3d67-495e-b013-448c1e131fc2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.073099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.074232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.076750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.077132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] PATH_INFO: `/v3/projects/8c638d9bdca544a5bf19335c06b141d1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.081524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c638d9bdca544a5bf19335c06b141d1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.087929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.099535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 871/1726] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:23 2021] POST /identity/v3/projects => generated 405 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:24.105318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.197847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c638d9bdca544a5bf19335c06b141d1', 'request_id': 'req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:24.212725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c638d9bdca544a5bf19335c06b141d1', 'request_id': 'req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:24.241683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c638d9bdca544a5bf19335c06b141d1', 'request_id': 'req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:24.272375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] The token cache is being invalidate because project 8c638d9bdca544a5bf19335c06b141d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:24.273128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:24.274812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-49ef8a45-0c4c-4745-b6ca-1848af95b3d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:24.277996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 856/1727] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:24 2021] DELETE /identity/v3/projects/8c638d9bdca544a5bf19335c06b141d1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:24.286604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284708e0-c099-4e49-9098-367a360f7b9a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.287946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284708e0-c099-4e49-9098-367a360f7b9a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.288911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284708e0-c099-4e49-9098-367a360f7b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.304602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd478f-5339-4905-8002-039cac458228 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.380162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-284708e0-c099-4e49-9098-367a360f7b9a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:24.384252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-284708e0-c099-4e49-9098-367a360f7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:24.421887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.423149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.423421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.423921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.424789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.427139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.458105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 872/1728] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/users => generated 309 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:24.459051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.464119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:24.478554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24028a14-210e-4538-8f3b-ffdf8a1d2e3f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.497373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.500435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.501919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.503264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.506859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.508923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.518586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 857/1729] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:24.522229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.522706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.523099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.540452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 873/1730] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:24.541822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.558418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c98d9e-1f49-4f81-9934-d4d6994625b3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.564036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.564933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.565224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.565509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] PATH_INFO: `/v3/projects/632bdf1ad52749bf902f30f53e88a1fc/users/4e29b5e23c624cde8d7ecb4a1e030d3e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.578673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:24.582209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:24.585143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=632bdf1ad52749bf902f30f53e88a1fc, user_id=4e29b5e23c624cde8d7ecb4a1e030d3e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.588034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.610903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 874/1731] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:24 2021] PUT /identity/v3/projects/632bdf1ad52749bf902f30f53e88a1fc/users/4e29b5e23c624cde8d7ecb4a1e030d3e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:24.615680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.623982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 858/1732] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:24.627108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.651000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8fc92-eccd-40fb-8891-55151326ce93 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.756596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a04fb-cf0a-4ec8-a847-e528c5ba6e3c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.756842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.757280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.757563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.757833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.758603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:24.759038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.760644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.762526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.763390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.763679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.763959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.764722 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.766929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.782448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 875/1733] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:24 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:24.787425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.799669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981cec-b0e0-4661-a7c4-c6f3ecfc1051 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.803875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 859/1734] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:24.806196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:24.806717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.807841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.808335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.808771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] PATH_INFO: `/v3/projects/632bdf1ad52749bf902f30f53e88a1fc/users/4e29b5e23c624cde8d7ecb4a1e030d3e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.811669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=632bdf1ad52749bf902f30f53e88a1fc, user_id=4e29b5e23c624cde8d7ecb4a1e030d3e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.816783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8484-36ac-4182-abb3-bf5d1480b37c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.827782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293495a-661e-40ae-bf7e-3ed1966b24c1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:24.836387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 876/1735] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:24 2021] PUT /identity/v3/projects/632bdf1ad52749bf902f30f53e88a1fc/users/4e29b5e23c624cde8d7ecb4a1e030d3e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:24.847006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.847445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.847725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.883810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] MFA Rules not processed for user `4e29b5e23c624cde8d7ecb4a1e030d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:24.885823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:24.920961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:24.921660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:24.922044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:24.922320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:24.923133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:24.926437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:24.986167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 860/1736] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:24.990341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.005335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 877/1737] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:25.018537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.021239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:25.121014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0043fb-b700-4b46-8260-fe1c170f1533 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.153525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15565b-b5dc-45a2-bc68-55cb8ff768a0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.162773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.164527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.164873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.165232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.166663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.170071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.237756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 861/1738] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:24 2021] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:25.243100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.255547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a89d8c-2154-4123-9dfe-906527c4124c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.256157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.256832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.257113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.257396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.262083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.262900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.263328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.263725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.264565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.267497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.280707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 862/1739] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:25.288549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.308846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255ea0c-9415-46b8-87d7-45bc50f5eecd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.316426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.318970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.319937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.320431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.322268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.324327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.341236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 863/1740] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:25 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:25.343152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.352198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.353690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83855c-8364-4131-881d-71a76ce169e1 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.357921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee39f6-e3b9-473d-8516-88fbdda5eaaf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.369534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 878/1741] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:25 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:25.372085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.373005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.373664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.373844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] PATH_INFO: `/v3/projects/e28df7fadbe64f018f3a5ee87be0d597/users/ab3fb65c74454c1f99458aa8c580f9cc/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.405357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28df7fadbe64f018f3a5ee87be0d597, user_id=ab3fb65c74454c1f99458aa8c580f9cc, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.409023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.429716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 864/1742] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:25 2021] PUT /identity/v3/projects/e28df7fadbe64f018f3a5ee87be0d597/users/ab3fb65c74454c1f99458aa8c580f9cc/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:25.442737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.443680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.443962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.482438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] MFA Rules not processed for user `ab3fb65c74454c1f99458aa8c580f9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:25.483742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:25.584665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 879/1743] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:25 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:25.589597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.616347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.674399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58c48-652d-4c7a-9a1b-870ee70fa75b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.680918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.681829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.682448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.682795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.683862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.686523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.705630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286907-a52b-44e9-955b-628f0368fb9a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.711624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.712740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.713282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.713713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] PATH_INFO: `/v3/users/467833f628de45bcb9938512ea823cb4` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.715680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467833f628de45bcb9938512ea823cb4)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.718033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.724601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 865/1744] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:25 2021] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:25.727130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.799975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467833f628de45bcb9938512ea823cb4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:25.801003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467833f628de45bcb9938512ea823cb4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:25.802260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467833f628de45bcb9938512ea823cb4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:25.814681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22988b3d-5d67-48fc-aeaa-3380b76ec5b8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.820882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:25.821591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.821950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467833f628de45bcb9938512ea823cb4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:25.822132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.822425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.823193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:25.825738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:25.833249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1c29553e-7eb4-4806-8936-c0cb75675854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467833f628de45bcb9938512ea823cb4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:25.853666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 866/1745] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:25 2021] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:25.855071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:25.856991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:25.858549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 880/1746] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:25 2021] DELETE /identity/v3/users/467833f628de45bcb9938512ea823cb4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:25.863542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:25.864142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:25.865020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:25.882374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3572a77-51b9-485c-91a9-990aceb716be admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:25.894146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:25.895433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.004332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.005172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.010309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 881/1747] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:26.012444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.012735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.013557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.015802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.017277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.021215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.033609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 867/1748] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:25 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:26.037941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.049519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06744e-6888-4fb9-b8ff-c7ba9aeff193 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.057268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.059923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.060337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.060715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] PATH_INFO: `/v3/projects/f4e29531ef8e4727856179bdfd634405/users/5cc2c98702d14acf951b1f515bf8f539/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.095315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482a620-98f4-4fcd-95e5-26730b7464a1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.096809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e29531ef8e4727856179bdfd634405, user_id=5cc2c98702d14acf951b1f515bf8f539, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.099401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.099928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.100360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.100772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.101046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.112412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.113899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.132668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 868/1749] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:26 2021] PUT /identity/v3/projects/f4e29531ef8e4727856179bdfd634405/users/5cc2c98702d14acf951b1f515bf8f539/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:26.137197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.139272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 882/1750] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:26.227082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b186-7a9f-459d-99d9-e68c4e47447e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.234011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.235459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.235761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.236157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.237027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.238827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb318ad-6b45-4be2-9f83-3f99cc8e9001 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.256339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 869/1751] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:26 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:26.256679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.277616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24700-d1af-41cd-837a-f6518167e877 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.283959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.285849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.286545 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.287027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] PATH_INFO: `/v3/projects/f4e29531ef8e4727856179bdfd634405/users/5cc2c98702d14acf951b1f515bf8f539/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.289374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e29531ef8e4727856179bdfd634405, user_id=5cc2c98702d14acf951b1f515bf8f539, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.292452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.306145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 883/1752] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:26 2021] PUT /identity/v3/projects/f4e29531ef8e4727856179bdfd634405/users/5cc2c98702d14acf951b1f515bf8f539/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:26.327634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.328204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.329287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.372575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] MFA Rules not processed for user `5cc2c98702d14acf951b1f515bf8f539`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:26.373976 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.502400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 870/1753] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:26 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:26.512229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.515014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.610479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1833-d2f2-4e58-a5d1-57ce82101fea admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.615114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.615854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.616147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.616433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.619050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.693746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.696196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:26.701270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.702837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.713343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 884/1754] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:26 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:26.785491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa91e8a-d1e3-455e-81ba-beb1da5f89d9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.791624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.792689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.793085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.793462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] PATH_INFO: `/v3/projects/feb4cd298bb346fbaae4b039de274b52` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.795224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb4cd298bb346fbaae4b039de274b52)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.798823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:26.853012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb4cd298bb346fbaae4b039de274b52', 'request_id': 'req-f7881d03-45a9-4979-9d84-f414dc67d7e3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:26.859012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb4cd298bb346fbaae4b039de274b52', 'request_id': 'req-f7881d03-45a9-4979-9d84-f414dc67d7e3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:26.864983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb4cd298bb346fbaae4b039de274b52', 'request_id': 'req-f7881d03-45a9-4979-9d84-f414dc67d7e3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:26.878530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] The token cache is being invalidate because project feb4cd298bb346fbaae4b039de274b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:26.878833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:26.879468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:26.881046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 871/1755] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:26 2021] DELETE /identity/v3/projects/feb4cd298bb346fbaae4b039de274b52 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:26.885404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:26.897604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890a4c1-b321-46d5-a06a-65dc30413b50 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:26.960483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:26.961497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:26.961783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:26.962056 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] PATH_INFO: `/v3/users/4e29b5e23c624cde8d7ecb4a1e030d3e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:26.963304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e29b5e23c624cde8d7ecb4a1e030d3e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:26.965248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.023773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e29b5e23c624cde8d7ecb4a1e030d3e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.024600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e29b5e23c624cde8d7ecb4a1e030d3e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.025350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e29b5e23c624cde8d7ecb4a1e030d3e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.047284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e29b5e23c624cde8d7ecb4a1e030d3e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.057126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-59349a3a-b851-4771-9313-ec27a3c10092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e29b5e23c624cde8d7ecb4a1e030d3e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.074859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 885/1756] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:26 2021] DELETE /identity/v3/users/4e29b5e23c624cde8d7ecb4a1e030d3e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:27.369131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.370668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:27.385897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7881d03-45a9-4979-9d84-f414dc67d7e3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.459753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.462111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.462400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.462733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] PATH_INFO: `/v3/projects/632bdf1ad52749bf902f30f53e88a1fc` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.464140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=632bdf1ad52749bf902f30f53e88a1fc)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.466152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.522479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632bdf1ad52749bf902f30f53e88a1fc', 'request_id': 'req-0541367d-0f2b-46de-83be-b3c17af0e90d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.529207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632bdf1ad52749bf902f30f53e88a1fc', 'request_id': 'req-0541367d-0f2b-46de-83be-b3c17af0e90d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.535744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632bdf1ad52749bf902f30f53e88a1fc', 'request_id': 'req-0541367d-0f2b-46de-83be-b3c17af0e90d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.549681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] The token cache is being invalidate because project 632bdf1ad52749bf902f30f53e88a1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:27.549979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.550680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0541367d-0f2b-46de-83be-b3c17af0e90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:27.552335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 872/1757] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:27 2021] DELETE /identity/v3/projects/632bdf1ad52749bf902f30f53e88a1fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:27.558388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.558952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.559028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.578471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:27.579934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:27.643921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 886/1758] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:27.648870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.649160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.649469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.668908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:27.670146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:27.679837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 873/1759] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:27.684191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.694230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb64fc-9219-4f95-9616-87435aa63b50 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.707469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.708142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.708444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.708732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.709472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:27.709799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.711540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.724136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 887/1760] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:27.728942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.738192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c81a5-6cce-40ef-9aae-068a61c21e9c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.742990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.743669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.743953 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.744226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.744950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.747101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.773904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 874/1761] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:27 2021] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:27.777959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.789719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5a037-875a-4247-a5ac-68e577ae3e74 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.849316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.850259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.850593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.850876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.851599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.853743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.875967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 888/1762] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:27 2021] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:27.880318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.890512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04479ed8-8150-4d47-8773-ae87bcc75ff3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.896445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.897112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.897392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.897712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.898450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.900095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.910877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 875/1763] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:27.915266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.927539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565df94a-ef49-409c-8e4b-3d38165ed517 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.933831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.934769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.935140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.935571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.936328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.939055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804cd9f-5222-4c0f-9316-cde7e704750e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:27.949691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 889/1764] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:27.954897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:27.965021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d0de7-c47a-48b6-8ec4-7d6a1aedd755 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:27.970418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:27.971334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:27.971619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:27.971895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] PATH_INFO: `/v3/projects/2dd326b2fa024993ba1d84b70be803b4/users/5e14d581099f4dfc912792b484695a41/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:27.988351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd326b2fa024993ba1d84b70be803b4, user_id=5e14d581099f4dfc912792b484695a41, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:27.991048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.005460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 876/1765] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:27 2021] PUT /identity/v3/projects/2dd326b2fa024993ba1d84b70be803b4/users/5e14d581099f4dfc912792b484695a41/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:28.015925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.016291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.016583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.043602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] MFA Rules not processed for user `5e14d581099f4dfc912792b484695a41`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:28.044744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:28.110367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 890/1766] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:28 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:28.115342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.178457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d89d-6e21-4846-af74-b1b5e65a0a65 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.183387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.184049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.184337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.184616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.185338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.187875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.216821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 877/1767] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:28 2021] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:28.218003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.229267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76e261-56c3-4f9d-b4ce-e18803a5b0ee None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.285774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.286453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.286760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.287031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.287737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.289703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.313534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 891/1768] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:28 2021] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:28.314489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.325827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550b584-f368-42a7-93a1-2d6e8c860f82 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.331016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.331893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.332714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.332714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.333759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.335556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.346333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 878/1769] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:28.351354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.363693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e139c-eee9-4bde-8aa3-08e146a22417 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.368328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.369213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.369496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.369770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] PATH_INFO: `/v3/projects/671aac68bc864d7fbc1dfd029b16c083/users/09230864bb2e4681add9cbb3c93366e5/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.385302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671aac68bc864d7fbc1dfd029b16c083, user_id=09230864bb2e4681add9cbb3c93366e5, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.388002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.401642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 892/1770] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:28 2021] PUT /identity/v3/projects/671aac68bc864d7fbc1dfd029b16c083/users/09230864bb2e4681add9cbb3c93366e5/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:28.405768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.416440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34622b6-2d61-4922-b882-fec18407df73 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.474855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.476052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.476350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.476633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.477388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.479083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c909147-a0c4-47eb-819f-be7de6d0b132 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.492988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 879/1771] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:28 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:28.494107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.505118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa1b22-cd19-4bda-9250-c4700b0f9585 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.509796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.510707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.510987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.511385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] PATH_INFO: `/v3/projects/671aac68bc864d7fbc1dfd029b16c083/users/09230864bb2e4681add9cbb3c93366e5/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.513356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671aac68bc864d7fbc1dfd029b16c083, user_id=09230864bb2e4681add9cbb3c93366e5, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.516810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.527092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 893/1772] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:28 2021] PUT /identity/v3/projects/671aac68bc864d7fbc1dfd029b16c083/users/09230864bb2e4681add9cbb3c93366e5/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:28.537530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.537820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.538100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.566826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] MFA Rules not processed for user `09230864bb2e4681add9cbb3c93366e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:28.568037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:28.639007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 880/1773] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:28 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:28.649548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.651353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:28.705922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953362c-955a-4a05-8846-1ae511368fc3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.709599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.710237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.710548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.710828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.720107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.721544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.730973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 894/1774] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:28 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:28.800124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:28.809743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88518f-898b-4409-aeb4-d06191623961 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:28.813908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:28.814672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:28.815003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:28.815349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:28.873207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:28.874722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f858919-6e5d-4fb0-a364-729a1e221bdc service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:28.885553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 881/1775] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:28 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:40.529108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:40.530625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:40.541415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04fca-163e-4328-9227-fa89d01b3df5 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:40.545077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:40.545743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:40.546029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:40.546306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:40.548586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:40.614940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:40.616412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d224170-96ff-44f7-ac5e-78632e1a7bb9 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:40.626774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 895/1776] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:40 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:42.733528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:42.734247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:42.734247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:42.736788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 882/1777] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:40:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:40:42.756434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:42.757908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:42.758573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:42.787450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:42.788829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:42.885122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 896/1778] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:40:42 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:42.900491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:42.902121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:42.921335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65407b82-71b8-458f-888f-d76ffd28e2c4 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:42.930636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:42.931369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:42.931658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:42.931936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:42.942050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:42.943675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788268fe-9993-4518-b15e-a90bf1a2f778 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:42.955278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 883/1779] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:51.283248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:51.284855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:51.354158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bb430-2073-42ad-8fb5-4d4e4830e958 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:51.358694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:51.360746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:51.361027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:51.361302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] PATH_INFO: `/v3/users/ab3fb65c74454c1f99458aa8c580f9cc` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:51.362532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3fb65c74454c1f99458aa8c580f9cc)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:51.364438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:51.408682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3fb65c74454c1f99458aa8c580f9cc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.409337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3fb65c74454c1f99458aa8c580f9cc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.410012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3fb65c74454c1f99458aa8c580f9cc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.422663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3fb65c74454c1f99458aa8c580f9cc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.429767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3fb65c74454c1f99458aa8c580f9cc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.441862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 897/1780] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:51 2021] DELETE /identity/v3/users/ab3fb65c74454c1f99458aa8c580f9cc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:51.446835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:51.447464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:51.447464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:51.465383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:51.466641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:51.530455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 884/1781] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:51.541680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:51.543095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:51.616619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5287-f6e5-41e8-9c75-a56af2a81da5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:51.621845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:51.622709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:51.622976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:51.623258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:51.640433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:51.642471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985962e-c27f-493e-84e7-c94630d27560 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:51.657923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 898/1782] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:51.894058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:51.895797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:51.908282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd3148-9646-4377-b24f-be93838c703a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:51.913278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:51.914167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:51.914447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:51.914768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] PATH_INFO: `/v3/users/2bdd4f13216d410794b2dff3f5c162dc` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:51.915987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdd4f13216d410794b2dff3f5c162dc)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:51.917963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:51.966858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdd4f13216d410794b2dff3f5c162dc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.967518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdd4f13216d410794b2dff3f5c162dc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.975013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdd4f13216d410794b2dff3f5c162dc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.989014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdd4f13216d410794b2dff3f5c162dc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:51.997072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdd4f13216d410794b2dff3f5c162dc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.004471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 885/1783] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:51 2021] DELETE /identity/v3/users/2bdd4f13216d410794b2dff3f5c162dc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:52.009247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:52.009540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:52.009821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:52.014769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:52.018533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.028731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:52.030369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.120266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aa42f-7ecc-4dd5-a9f6-c827551c79d4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:52.131373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 899/1784] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:52.134766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:52.135662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:52.135947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:52.136227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] PATH_INFO: `/v3/projects/e28df7fadbe64f018f3a5ee87be0d597` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:52.141287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28df7fadbe64f018f3a5ee87be0d597)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:52.142707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:52.143588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:52.144325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.203567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28df7fadbe64f018f3a5ee87be0d597', 'request_id': 'req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.215509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28df7fadbe64f018f3a5ee87be0d597', 'request_id': 'req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.229343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28df7fadbe64f018f3a5ee87be0d597', 'request_id': 'req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.246371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edf44b-a3d5-4699-9a73-3a44e22fc896 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:52.253006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] The token cache is being invalidate because project e28df7fadbe64f018f3a5ee87be0d597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:52.253480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.254899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.258649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 886/1785] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:52 2021] DELETE /identity/v3/projects/e28df7fadbe64f018f3a5ee87be0d597 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:52.263136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:52.265654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.319772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:52.320431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:52.320984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:52.321414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:52.326877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.360028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1378b-a28f-4d9d-afd8-bfea5629d2e4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:52.383328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:52.384422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:52.386444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:52.386444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] PATH_INFO: `/v3/users/5cc2c98702d14acf951b1f515bf8f539` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:52.389775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc2c98702d14acf951b1f515bf8f539)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:52.392639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:52.466619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:52.468325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:52.480400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 900/1786] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:52.498895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc2c98702d14acf951b1f515bf8f539'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.500382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc2c98702d14acf951b1f515bf8f539'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.510784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc2c98702d14acf951b1f515bf8f539'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.529803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc2c98702d14acf951b1f515bf8f539'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.548612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc2c98702d14acf951b1f515bf8f539'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:52.566789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 887/1787] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:52 2021] DELETE /identity/v3/users/5cc2c98702d14acf951b1f515bf8f539 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:52.957148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:52.960767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:52.973709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9dc3-b438-4c78-aaef-eb5b94482eb9 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.052273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.055433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.055433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.055433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] PATH_INFO: `/v3/projects/acbc2e76166240e5ac899c310cbc4ac6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.057166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbc2e76166240e5ac899c310cbc4ac6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.059308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.096461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.098573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:53.119151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b699-d8fa-48bf-b9c0-a36ade5dab26 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.125477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.126909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.127895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.128465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] PATH_INFO: `/v3/projects/f4e29531ef8e4727856179bdfd634405` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.129826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e29531ef8e4727856179bdfd634405)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.147944 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbc2e76166240e5ac899c310cbc4ac6', 'request_id': 'req-146faedf-c7b8-432a-b947-aae3c76d23fc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.152066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.164892 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbc2e76166240e5ac899c310cbc4ac6', 'request_id': 'req-146faedf-c7b8-432a-b947-aae3c76d23fc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.179263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbc2e76166240e5ac899c310cbc4ac6', 'request_id': 'req-146faedf-c7b8-432a-b947-aae3c76d23fc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.196262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] The token cache is being invalidate because project acbc2e76166240e5ac899c310cbc4ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:53.196740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.197643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.200599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 901/1788] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:52 2021] DELETE /identity/v3/projects/acbc2e76166240e5ac899c310cbc4ac6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:53.205853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.208090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:53.246104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e29531ef8e4727856179bdfd634405', 'request_id': 'req-4e8fba70-51dd-4b48-8598-e4d5d78847d4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.258143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e29531ef8e4727856179bdfd634405', 'request_id': 'req-4e8fba70-51dd-4b48-8598-e4d5d78847d4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.274752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e29531ef8e4727856179bdfd634405', 'request_id': 'req-4e8fba70-51dd-4b48-8598-e4d5d78847d4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.303034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] The token cache is being invalidate because project f4e29531ef8e4727856179bdfd634405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:53.303348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.304020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4e8fba70-51dd-4b48-8598-e4d5d78847d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.305599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 888/1789] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:53 2021] DELETE /identity/v3/projects/f4e29531ef8e4727856179bdfd634405 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:53.306770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146faedf-c7b8-432a-b947-aae3c76d23fc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.312896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4f8e-24c5-4648-80c8-fda73b94c0c0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.313493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4f8e-24c5-4648-80c8-fda73b94c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.313834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4f8e-24c5-4648-80c8-fda73b94c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.333412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e87b4f8e-24c5-4648-80c8-fda73b94c0c0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:53.334691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e87b4f8e-24c5-4648-80c8-fda73b94c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:53.395317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.396233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.396518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.396794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] PATH_INFO: `/v3/users/4db14bfab8ff426b9997c8025e7fc620` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.407667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db14bfab8ff426b9997c8025e7fc620)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.409712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.418254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 889/1790] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:53.422524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.422524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.422770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.446899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:53.449165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:53.461241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 890/1791] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:53.466255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.482912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33be8b5-0640-4977-bb40-ff145cf60af3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.490638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.492603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.493286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.493653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.494589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:53.494909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.497368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.511552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db14bfab8ff426b9997c8025e7fc620'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.512610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db14bfab8ff426b9997c8025e7fc620'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.513486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db14bfab8ff426b9997c8025e7fc620'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.520978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 891/1792] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:53.521894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.524067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:53.538683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db14bfab8ff426b9997c8025e7fc620'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.548947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db14bfab8ff426b9997c8025e7fc620'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:53.552669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43e7c2-8b11-4120-9b19-658740e9d907 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.558883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.559728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.560015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.560298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.561402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.563908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.567199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 902/1793] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:53 2021] DELETE /identity/v3/users/4db14bfab8ff426b9997c8025e7fc620 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:53.606564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 892/1794] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:53 2021] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:53.608084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.738675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c77679-66ad-4874-b049-c9ce7beb8f12 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.809000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.809724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.810006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.810306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.811040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.814128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.839354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 903/1795] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:53 2021] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:53.845248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.865807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37988967-670b-45a0-b947-ab7e903b6fed admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.871869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.872736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.872925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.873233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.874136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.876872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.888065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 893/1796] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:53 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:53.895107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.911949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc530-5fa3-4dbf-9af8-6f543410516e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.917793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.918666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.918871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.919157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.919927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.922468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31055-e8ce-4798-a620-a6b9f76df50a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:53.942284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 904/1797] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:53 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:53.942980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:53.957866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc103-562f-46e4-b34e-4ac06018f851 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:53.963624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:53.964531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:53.964856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:53.965149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] PATH_INFO: `/v3/projects/2b7c76f73532419cacbb0b4eff829a6b/users/3a48d80664ba45babb77c47bdad0cdd8/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:53.983348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7c76f73532419cacbb0b4eff829a6b, user_id=3a48d80664ba45babb77c47bdad0cdd8, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:53.986715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.003006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 894/1798] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:53 2021] PUT /identity/v3/projects/2b7c76f73532419cacbb0b4eff829a6b/users/3a48d80664ba45babb77c47bdad0cdd8/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:54.013949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.014249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.014541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.044052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.045108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] MFA Rules not processed for user `3a48d80664ba45babb77c47bdad0cdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:54.046944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.047065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.137053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 905/1799] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:54.143636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefcb3c-16dd-4c80-acaf-489338c55574 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.148772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.149649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.149939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.150316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] PATH_INFO: `/v3/projects/480e8875b51a460bbbaaa0832f73e1b5` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.151454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.152979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.153074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480e8875b51a460bbbaaa0832f73e1b5)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.155008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.210888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480e8875b51a460bbbaaa0832f73e1b5', 'request_id': 'req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:54.217837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480e8875b51a460bbbaaa0832f73e1b5', 'request_id': 'req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:54.221245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d61c-9201-42b7-8ca9-ceac79fabe11 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.225936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480e8875b51a460bbbaaa0832f73e1b5', 'request_id': 'req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:54.245799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] The token cache is being invalidate because project 480e8875b51a460bbbaaa0832f73e1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:54.246249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:54.247055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-efa4e034-8e18-4e3b-90b0-3b89f5783bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:54.250798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 895/1800] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:54 2021] DELETE /identity/v3/projects/480e8875b51a460bbbaaa0832f73e1b5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:54.259008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.259393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.259757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.284575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:54.284938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.285684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.285962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.286247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.287620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.290420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.362980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.364667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e14c35-361c-4b65-a138-e804a6e8622b service glance] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.376964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 906/1801] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:54 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:54.402648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 896/1802] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:54.447594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.447962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.448058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.470363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:54.471873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:54.486301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 907/1803] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:54.488061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.499997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40739b-e701-41c4-8832-2f7f2b79a927 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.507248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.508026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.509265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.509552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.510702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:54.511022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.512610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.535010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 897/1804] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:54.538631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.549087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d06458-f884-4a21-8465-5a2e45a6e97f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.558890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.559614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.559955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.560326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.561681 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.564947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.612376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 908/1805] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:54.616389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.634681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4275f2-b2e3-4c3a-8dfe-abb26b037caf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.744658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.746124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.746800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.747327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.748686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.752349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.781999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 898/1806] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:54.783607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.799170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b29b-b4eb-4727-a75b-cf79e3c41b59 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.806079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.808128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.808828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.809442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.810588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.814167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.830954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 909/1807] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:54 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:54.835475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.853241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22798c-5220-436d-86a1-88997b57eba4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.872648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.873483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.873773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.874050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.875052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.876731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913c27a-731b-4e8b-9a31-222143253cc0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.898333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 899/1808] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:54 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:54.902478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:54.917136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bbf0a-37d4-4850-b9e5-9ca6c154e614 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:54.930009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:54.931103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:54.932963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:54.933329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] PATH_INFO: `/v3/projects/dd2baaf251914545bc9d3cca4ea2e741/users/087c7408b9cb4d90b858940ca4e59718/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:54.966742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2baaf251914545bc9d3cca4ea2e741, user_id=087c7408b9cb4d90b858940ca4e59718, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:54.971272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:54.990973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 910/1809] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:54 2021] PUT /identity/v3/projects/dd2baaf251914545bc9d3cca4ea2e741/users/087c7408b9cb4d90b858940ca4e59718/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:54.999848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.000138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.000437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.034118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] MFA Rules not processed for user `087c7408b9cb4d90b858940ca4e59718`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:55.035530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.177870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 900/1810] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:54 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:55.182168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.324987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86fef9-3ff4-4956-9f17-c54baf3bbb41 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.336682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.337999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.338565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.339675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.340602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.345789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.388342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 911/1811] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:55 2021] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:55.392715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.407144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.407322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889991a5-e291-4ba3-97c9-b153e4591f1f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.408971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.520505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb4c25-962a-46ff-9a17-3e89eed8a38b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.524762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.525462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.525755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.526034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.527283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.529832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.534251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.539577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.539871 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.540158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] PATH_INFO: `/v3/users/5e14d581099f4dfc912792b484695a41` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.547997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e14d581099f4dfc912792b484695a41)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.550019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.566582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 901/1812] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:55 2021] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:55.567584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.580110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc419d-03e5-4487-9bfb-77281ad2975f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.585170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.585974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.586535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.586872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.587698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.590053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.602926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 902/1813] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:55.607943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.621584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e6f24-3d9c-4aad-a098-5767b753e591 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.628935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.629213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e14d581099f4dfc912792b484695a41'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:55.629850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.630136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e14d581099f4dfc912792b484695a41'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:55.630239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.630416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] PATH_INFO: `/v3/projects/a09a530ed5874b4e81fd1806795739e7/users/9990fe1cccd9450fb849a94efe8b76dd/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.632174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e14d581099f4dfc912792b484695a41'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:55.652090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09a530ed5874b4e81fd1806795739e7, user_id=9990fe1cccd9450fb849a94efe8b76dd, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.654051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e14d581099f4dfc912792b484695a41'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:55.662626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.674102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-35178ca7-c63a-4e02-b2dd-35b3589c830a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e14d581099f4dfc912792b484695a41'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:55.685982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 903/1814] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:55 2021] PUT /identity/v3/projects/a09a530ed5874b4e81fd1806795739e7/users/9990fe1cccd9450fb849a94efe8b76dd/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:55.687598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.689460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.694919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 912/1815] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:55 2021] DELETE /identity/v3/users/5e14d581099f4dfc912792b484695a41 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:55.699895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.700217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.700568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.729550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:55.730955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.811300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 913/1816] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:55.818182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace05b8-e04c-4d6f-aa11-86272c8cfb58 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.824369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.826037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.826037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.826037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.828817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.829612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.833032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.834616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.841948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 904/1817] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:55 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:55.847174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:55.857954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852ef10-0b5d-4a96-99b3-cc8f39d8e2a9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.867998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.869245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.869542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.869880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] PATH_INFO: `/v3/projects/a09a530ed5874b4e81fd1806795739e7/users/9990fe1cccd9450fb849a94efe8b76dd/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.872730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09a530ed5874b4e81fd1806795739e7, user_id=9990fe1cccd9450fb849a94efe8b76dd, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:55.876447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009ef1b-3987-4f77-adc8-64dc5600831d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:55.888839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 905/1818] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:55 2021] PUT /identity/v3/projects/a09a530ed5874b4e81fd1806795739e7/users/9990fe1cccd9450fb849a94efe8b76dd/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:55.901143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.901442 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.901721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:55.916867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735859e-57ad-4128-b0d7-fe0e20272aec None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:55.937915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] MFA Rules not processed for user `9990fe1cccd9450fb849a94efe8b76dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:55.939266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:55.992915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:55.993673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:55.994027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:55.994400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:56.015763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 906/1819] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:55 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:56.026036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:56.027545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:56.060158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:56.061693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:56.072908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 914/1820] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:56.091535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddbbcc-9e9e-4b56-8f74-86862d0fad47 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:56.096158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:56.096814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:56.097093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:56.097635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:56.107157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:56.109266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:56.120343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 907/1821] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:56 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:40:56.194394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:56.205462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0991242-0b06-4f0d-9ec3-34f16b1c3d2f service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:56.209062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:56.209787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:56.210106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:56.210436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:56.212452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:56.307354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:56.308869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:56.319345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 915/1822] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:56 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:56.381661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:56.383362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:56.404332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268d7b-630b-4c64-880c-b8eca6a4f9e6 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:56.417553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:56.418635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:56.418996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:56.419348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] PATH_INFO: `/v3/projects/2dd326b2fa024993ba1d84b70be803b4` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:56.420852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd326b2fa024993ba1d84b70be803b4)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:56.423159 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:56.517522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd326b2fa024993ba1d84b70be803b4', 'request_id': 'req-acc3d23e-6c06-4861-919b-324ba006a2e0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.524342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd326b2fa024993ba1d84b70be803b4', 'request_id': 'req-acc3d23e-6c06-4861-919b-324ba006a2e0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.530550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd326b2fa024993ba1d84b70be803b4', 'request_id': 'req-acc3d23e-6c06-4861-919b-324ba006a2e0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.543662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] The token cache is being invalidate because project 2dd326b2fa024993ba1d84b70be803b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:56.543957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.544595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.549455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 908/1823] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:56 2021] DELETE /identity/v3/projects/2dd326b2fa024993ba1d84b70be803b4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:56.550706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:56.566161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24540-db95-465b-a378-c455a560bb83 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:56.627531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:56.628438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:56.628716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:56.629013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] PATH_INFO: `/v3/users/09230864bb2e4681add9cbb3c93366e5` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:56.630243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09230864bb2e4681add9cbb3c93366e5)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:56.632240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:56.683760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09230864bb2e4681add9cbb3c93366e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.684575 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09230864bb2e4681add9cbb3c93366e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.685282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09230864bb2e4681add9cbb3c93366e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.699963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09230864bb2e4681add9cbb3c93366e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.711605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-37da3db5-5aa0-4359-8507-ed1c2941b399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09230864bb2e4681add9cbb3c93366e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:56.730589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 916/1824] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:56 2021] DELETE /identity/v3/users/09230864bb2e4681add9cbb3c93366e5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:57.027850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.029308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:57.050013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d23e-6c06-4861-919b-324ba006a2e0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.119103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.120022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.120301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.120579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] PATH_INFO: `/v3/projects/671aac68bc864d7fbc1dfd029b16c083` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.121793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671aac68bc864d7fbc1dfd029b16c083)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.123745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.188543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671aac68bc864d7fbc1dfd029b16c083', 'request_id': 'req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:57.203280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671aac68bc864d7fbc1dfd029b16c083', 'request_id': 'req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:57.210053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671aac68bc864d7fbc1dfd029b16c083', 'request_id': 'req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:57.224046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] The token cache is being invalidate because project 671aac68bc864d7fbc1dfd029b16c083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:40:57.224342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:57.225240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f0c8e20d-f4d5-4024-bc57-bd85cf1e97f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:57.226839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 909/1825] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:40:57 2021] DELETE /identity/v3/projects/671aac68bc864d7fbc1dfd029b16c083 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:40:57.234382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.234702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.234988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.252768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:57.254000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:57.323215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 917/1826] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:57.331331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.331740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.332314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.358335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:57.360351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:57.368890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 910/1827] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:57.373013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.382580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc163bd-bcfe-40fb-a52c-af21cad0a1a5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.387093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.387748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.388027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.388295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.389039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:40:57.389338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.391109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.403912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 918/1828] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:40:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:40:57.409861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.419521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343df1-f4ea-4cc0-82ec-f929b4f23cda None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.426083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.426781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.427064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.428412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.429147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.431238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.460210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 911/1829] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:40:57 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:40:57.464260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.476151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37a05-3170-48fc-ad11-abfebc460124 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.544996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.545832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.546175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.546712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.547459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.549637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.580148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 919/1830] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:40:57 2021] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:40:57.584015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.598481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4d8d7-063c-456b-ae38-a68695af746d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.604329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.605179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.606291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.614889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.614889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.614889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.627236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 912/1831] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:57 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:40:57.629023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.643595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3ec85-66e7-4ea9-a000-ea28fa63c8ee admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.651989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.653055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.653510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.653968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.655024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.659283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd3cf2-d3d2-44ed-8d8f-18ba7b00311d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.684051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 920/1832] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:40:57 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:40:57.687322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.698394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b82c9-2bd2-4a67-b2fe-d2b7035c8288 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:57.707932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:57.710232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.711737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.712194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] PATH_INFO: `/v3/projects/040dd15295834fa9ae11ab9078664b4f/users/424c54df4d614706bd07757e8c03b23b/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.740286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] RBAC: Authorizing `identity:create_grant(project_id=040dd15295834fa9ae11ab9078664b4f, user_id=424c54df4d614706bd07757e8c03b23b, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:57.743401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:57.771438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 913/1833] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:40:57 2021] PUT /identity/v3/projects/040dd15295834fa9ae11ab9078664b4f/users/424c54df4d614706bd07757e8c03b23b/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:57.776580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:57.776875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:57.777136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:57.834047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] MFA Rules not processed for user `424c54df4d614706bd07757e8c03b23b`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:57.835491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:57.961671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 921/1834] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:40:57.973674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:57.975671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:58.052501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdfeef-96f1-4b0c-8f3c-ea349e0c854a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:58.065124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:58.066034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:58.066898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:58.067647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:58.080354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:58.080555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6ba4d-3f40-4101-be41-201aefb1ba2d service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:58.090850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 914/1835] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:57 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:40:59.276690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:59.278279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:59.344721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807e7e-4331-4175-991b-e304d6ca8c3d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:59.349120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:59.350253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:59.350684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:59.350958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] PATH_INFO: `/v3/users/087c7408b9cb4d90b858940ca4e59718` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:59.352161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087c7408b9cb4d90b858940ca4e59718)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:59.354075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:59.402884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087c7408b9cb4d90b858940ca4e59718'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:59.403572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087c7408b9cb4d90b858940ca4e59718'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:59.404197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087c7408b9cb4d90b858940ca4e59718'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:59.417189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087c7408b9cb4d90b858940ca4e59718'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:59.425677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087c7408b9cb4d90b858940ca4e59718'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:40:59.444583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 922/1836] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:40:59 2021] DELETE /identity/v3/users/087c7408b9cb4d90b858940ca4e59718 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:40:59.446528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:59.447230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:59.447609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:59.471044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:40:59.472243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:59.557971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 915/1837] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:40:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:40:59.571383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:40:59.572987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:40:59.670199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73c7f8-937e-47fa-be3d-4320ebc9b6f9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:40:59.682007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:40:59.682778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:40:59.683064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:40:59.683344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:40:59.700576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:40:59.702245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:40:59.714179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 923/1838] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:40:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:00.149592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:00.152346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:00.173337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f790d5-aa1a-4bb6-9933-f4bf8f00191e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:00.180592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:00.181580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:00.182577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:00.182577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] PATH_INFO: `/v3/projects/dd2baaf251914545bc9d3cca4ea2e741` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:00.184710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2baaf251914545bc9d3cca4ea2e741)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:00.189383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:00.246427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2baaf251914545bc9d3cca4ea2e741', 'request_id': 'req-384b5b5d-f574-4f87-b90f-a4f94d837719'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.253709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2baaf251914545bc9d3cca4ea2e741', 'request_id': 'req-384b5b5d-f574-4f87-b90f-a4f94d837719'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.259162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2baaf251914545bc9d3cca4ea2e741', 'request_id': 'req-384b5b5d-f574-4f87-b90f-a4f94d837719'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.272592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] The token cache is being invalidate because project dd2baaf251914545bc9d3cca4ea2e741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:00.272886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.273532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.275230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 916/1839] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:00 2021] DELETE /identity/v3/projects/dd2baaf251914545bc9d3cca4ea2e741 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:00.279149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:00.289640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87075d6-a6dd-4c22-ad36-0c6e1eb9aceb service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:00.351310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:00.353344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:00.353778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:00.354488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] PATH_INFO: `/v3/users/9990fe1cccd9450fb849a94efe8b76dd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:00.356116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9990fe1cccd9450fb849a94efe8b76dd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:00.358061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:00.407037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9990fe1cccd9450fb849a94efe8b76dd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.407714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9990fe1cccd9450fb849a94efe8b76dd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.408346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9990fe1cccd9450fb849a94efe8b76dd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.422170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9990fe1cccd9450fb849a94efe8b76dd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.434047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-477ff264-2e4c-42d0-b87a-bf8512b9fd96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9990fe1cccd9450fb849a94efe8b76dd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.447037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 924/1840] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:00 2021] DELETE /identity/v3/users/9990fe1cccd9450fb849a94efe8b76dd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:00.766226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:00.767765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:00.782344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b5b5d-f574-4f87-b90f-a4f94d837719 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:00.857471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:00.859433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:00.859977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:00.859977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] PATH_INFO: `/v3/projects/a09a530ed5874b4e81fd1806795739e7` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:00.861961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09a530ed5874b4e81fd1806795739e7)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:00.863935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:00.930801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09a530ed5874b4e81fd1806795739e7', 'request_id': 'req-020ca2a6-0aef-45e7-92fc-966ae900d628'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.940986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09a530ed5874b4e81fd1806795739e7', 'request_id': 'req-020ca2a6-0aef-45e7-92fc-966ae900d628'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.948929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09a530ed5874b4e81fd1806795739e7', 'request_id': 'req-020ca2a6-0aef-45e7-92fc-966ae900d628'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.964084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] The token cache is being invalidate because project a09a530ed5874b4e81fd1806795739e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:00.964505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.965385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-020ca2a6-0aef-45e7-92fc-966ae900d628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:00.967598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 917/1841] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:00 2021] DELETE /identity/v3/projects/a09a530ed5874b4e81fd1806795739e7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:00.976259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:00.976639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:00.977021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.000643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:01.002093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:01.067947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 925/1842] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:01.077315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.078410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.078921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.105511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:01.106808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:01.115309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 918/1843] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:01.119914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.130576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b630-2e1a-4def-adb7-134d5b712564 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.135394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.136153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.136440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.136715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.137621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:01.137930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.139633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.153754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 926/1844] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:41:01.158781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.168432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f4026-ce93-4a7c-b250-9ef178024cfc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.175432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.176491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.176783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.177067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.177916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.179975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.209718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 919/1845] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:01.214255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.227693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df5f7-8823-4c64-a1a7-5a2e2c833b0a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.331623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.332319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.332608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.332877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.333640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.335965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.359010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 927/1846] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:01.363571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.373725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3b509-0811-424a-9772-0c911a9f6096 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.379105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.379774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.380047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.380321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.381062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.382692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.393356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 920/1847] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:01.397461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.408981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13edc7d-5baf-44f3-9ce8-194b8a2d36cb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.413911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.414621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.414912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.415192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.415948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.417564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5c835-7495-4557-94f3-64f6ec2053b5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.428989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 928/1848] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:41:01.433395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.444418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e20676-cb1a-4ee7-a47a-e92676d95dc2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.450129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.451247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.451537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.451820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] PATH_INFO: `/v3/projects/02b35ecd20ab44248330b768b3cd2cba/users/4bbf9d93d6604829b5ed43dfb50e0223/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.468040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b35ecd20ab44248330b768b3cd2cba, user_id=4bbf9d93d6604829b5ed43dfb50e0223, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.471478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.487058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 921/1849] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:01 2021] PUT /identity/v3/projects/02b35ecd20ab44248330b768b3cd2cba/users/4bbf9d93d6604829b5ed43dfb50e0223/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:01.497500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.497831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.498149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.527058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] MFA Rules not processed for user `4bbf9d93d6604829b5ed43dfb50e0223`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:01.528265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:01.643562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 929/1850] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:01.647942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.736514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d98424-cbca-4eeb-a019-bddda413285d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.743296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.744254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.744544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.744827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.745557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.748912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.781036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 922/1851] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:01.786074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.807896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934e85d-df30-4e17-9c1d-ae7097899bde None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.883479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.884321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.884610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.884971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.885796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.888136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.919890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 930/1852] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:01 2021] POST /identity/v3/users => generated 306 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:01.924905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.936408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613876a-4a68-467c-a204-1300242f78b1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.942216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.942940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.943227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.943506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.944260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.945896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:01.958281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 923/1853] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:01.962272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:01.972451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02703-e858-48b6-be15-57bc67307cac admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:01.978117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:01.978973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:01.979255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:01.979533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] PATH_INFO: `/v3/projects/b6af5aa3805a428db367e7a5d253a65c/users/c6f8c65371a0492e92234dce11839d60/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:01.995881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6af5aa3805a428db367e7a5d253a65c, user_id=c6f8c65371a0492e92234dce11839d60, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:01.998601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:02.015075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 931/1854] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:01 2021] PUT /identity/v3/projects/b6af5aa3805a428db367e7a5d253a65c/users/c6f8c65371a0492e92234dce11839d60/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:02.018862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:02.029153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16d90-afc7-4705-aadd-e3b4eb3c6199 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:02.101815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:02.102540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:02.102827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:02.103105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:02.103858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:02.105829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f2e7-0304-4e8c-bfcc-af745f47be56 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:02.117097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 924/1855] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:02 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:02.121384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:02.132481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f2ae-5113-4cca-a843-d39ae3a65c4d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:02.137261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:02.138548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:02.138742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:02.139024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] PATH_INFO: `/v3/projects/b6af5aa3805a428db367e7a5d253a65c/users/c6f8c65371a0492e92234dce11839d60/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:02.141790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6af5aa3805a428db367e7a5d253a65c, user_id=c6f8c65371a0492e92234dce11839d60, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:02.144829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:02.165633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 932/1856] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:02 2021] PUT /identity/v3/projects/b6af5aa3805a428db367e7a5d253a65c/users/c6f8c65371a0492e92234dce11839d60/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:02.166962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:02.167260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:02.167543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:02.204423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] MFA Rules not processed for user `c6f8c65371a0492e92234dce11839d60`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:02.205891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:02.283544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 925/1857] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:02 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:02.294000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:02.296967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:02.371700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e908d5-309f-459f-9511-3a70eaea2571 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:02.376444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:02.377574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:02.377920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:02.378270 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:02.390403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:02.391909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:02.402448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 933/1858] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:02 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:02.481265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:02.494067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35737d65-c6a3-4759-b165-7ec12217fa7e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:02.497788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:02.498461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:02.498777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:02.499133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:02.568306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:02.568959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66216cb4-32d2-4037-81dc-b557ac53caa4 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:02.578949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 926/1859] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:02 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:09.784312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:09.785726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:09.852149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda995c-58bb-498d-af65-bb9a842d258b service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:09.856703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:09.857569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:09.857850 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:09.858123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] PATH_INFO: `/v3/users/424c54df4d614706bd07757e8c03b23b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:09.859522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] RBAC: Authorizing `identity:delete_user(user_id=424c54df4d614706bd07757e8c03b23b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:09.861705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:09.910417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424c54df4d614706bd07757e8c03b23b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:09.911116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424c54df4d614706bd07757e8c03b23b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:09.911713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424c54df4d614706bd07757e8c03b23b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:09.923507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424c54df4d614706bd07757e8c03b23b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:09.930909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424c54df4d614706bd07757e8c03b23b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:09.944024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 934/1860] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:09 2021] DELETE /identity/v3/users/424c54df4d614706bd07757e8c03b23b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:09.948655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:09.949155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:09.949263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:09.967846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:09.969069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.038341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 927/1861] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:10.048777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.050212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.110189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e01d2-798c-43af-bded-9a966db5026a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.115612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.116268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.116623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.116899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.128074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.129516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af346d81-4a31-45aa-a02a-2e6808f1c26a service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.142174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 935/1862] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:10.422532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.424726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.439705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15e96a-6a42-45bf-bed7-caa1ee52cc15 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.444744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.445630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.445912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.446187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] PATH_INFO: `/v3/projects/040dd15295834fa9ae11ab9078664b4f` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.447439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=040dd15295834fa9ae11ab9078664b4f)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.449379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.502955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040dd15295834fa9ae11ab9078664b4f', 'request_id': 'req-6cdc08af-460c-4d30-ac4e-435831294eea'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:10.509246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040dd15295834fa9ae11ab9078664b4f', 'request_id': 'req-6cdc08af-460c-4d30-ac4e-435831294eea'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:10.514571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040dd15295834fa9ae11ab9078664b4f', 'request_id': 'req-6cdc08af-460c-4d30-ac4e-435831294eea'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:10.528022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] The token cache is being invalidate because project 040dd15295834fa9ae11ab9078664b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:10.528313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:10.528950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-6cdc08af-460c-4d30-ac4e-435831294eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:10.530514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 928/1863] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:10 2021] DELETE /identity/v3/projects/040dd15295834fa9ae11ab9078664b4f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:10.537500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a81895-b696-4377-b06f-571848f403e3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.537728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a81895-b696-4377-b06f-571848f403e3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.538010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a81895-b696-4377-b06f-571848f403e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.556660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-07a81895-b696-4377-b06f-571848f403e3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:10.557923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-07a81895-b696-4377-b06f-571848f403e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.618576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 936/1864] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:10.624777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.625069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.625352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.644609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:10.645821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.654001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 929/1865] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:10.659397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a81895-b696-4377-b06f-571848f403e3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.669103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a81895-b696-4377-b06f-571848f403e3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.674570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.675249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.675534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.675815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.676648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:10.676955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.678629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.690875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 937/1866] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:41:10.695514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.705036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98865f-dbc1-44f8-81e1-3595b76710b9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.709854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.710457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.710774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.711052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.711761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.713661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.739811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 930/1867] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:10 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:10.744425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.755451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc7fc-394b-4f37-9ab8-19ea01a0c3e1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.826315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.828129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.828663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.828949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.830328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.832629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.860317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 938/1868] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:10 2021] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:10.865677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.881725 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380dff4-e9da-4307-92d1-d6ba23f72bd7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.887634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.888455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.888740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.889022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.890582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.891483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.905854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 931/1869] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:10.911898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.933365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0100a-97ed-441e-a234-29c7aa53422a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.942919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.944112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.944624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.945302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.946902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.950009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.958881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.960663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:10.966623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 939/1870] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:10 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:10.971682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:10.978090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482155-e531-4765-b9cb-e080e9e7d66e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.982234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.983261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.983615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.983960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] PATH_INFO: `/v3/users/4bbf9d93d6604829b5ed43dfb50e0223` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:10.984557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9863239-e1fb-4b5b-afbd-9a3726bccb23 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:10.985302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbf9d93d6604829b5ed43dfb50e0223)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:10.987661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:10.990019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:10.990925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:10.991330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:10.991734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] PATH_INFO: `/v3/projects/273c545d66f0479bb21eb8012fb29558/users/5df79cdd584947ff967966692375c45c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.009457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273c545d66f0479bb21eb8012fb29558, user_id=5df79cdd584947ff967966692375c45c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:11.012701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936de08-788d-4d15-85c2-865cebfab9c5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:11.027388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 940/1871] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:10 2021] PUT /identity/v3/projects/273c545d66f0479bb21eb8012fb29558/users/5df79cdd584947ff967966692375c45c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:11.034034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.034342 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.034661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.040806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbf9d93d6604829b5ed43dfb50e0223'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.041638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbf9d93d6604829b5ed43dfb50e0223'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.049614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbf9d93d6604829b5ed43dfb50e0223'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.051992 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:11.053201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:11.061627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbf9d93d6604829b5ed43dfb50e0223'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.070482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a1085e72-d419-4f9d-9838-5809fb5cf724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbf9d93d6604829b5ed43dfb50e0223'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.077663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 932/1872] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:10 2021] DELETE /identity/v3/users/4bbf9d93d6604829b5ed43dfb50e0223 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:11.081883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.082637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.082637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.104041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:11.105263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:11.118851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 941/1873] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:11.129149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:11.130521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:11.176756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 933/1874] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:11.186322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:11.188004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:11.212799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1a2b-eb2e-4c04-92ac-4287c551c39e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:11.255610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b997-03f4-494a-9d15-279ebaadb0da None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:11.266046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:11.266046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.266046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.266046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.272458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:11.273275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.273654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.274036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.276427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:11.278064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:11.289034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 934/1875] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:11.293457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:11.294889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:11.306398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 942/1876] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:11.649486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:11.651042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:11.665583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397dc9b-9f68-458c-88c2-e112346a8c28 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:11.670466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:11.671364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.671650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.671951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] PATH_INFO: `/v3/projects/02b35ecd20ab44248330b768b3cd2cba` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.674085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b35ecd20ab44248330b768b3cd2cba)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:11.676158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:11.729239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b35ecd20ab44248330b768b3cd2cba', 'request_id': 'req-b7ad65ff-1b21-458d-8370-ae55e77f2374'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.736550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b35ecd20ab44248330b768b3cd2cba', 'request_id': 'req-b7ad65ff-1b21-458d-8370-ae55e77f2374'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.742195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b35ecd20ab44248330b768b3cd2cba', 'request_id': 'req-b7ad65ff-1b21-458d-8370-ae55e77f2374'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.756998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] The token cache is being invalidate because project 02b35ecd20ab44248330b768b3cd2cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:11.757293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.757936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b7ad65ff-1b21-458d-8370-ae55e77f2374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.760390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 935/1877] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:11 2021] DELETE /identity/v3/projects/02b35ecd20ab44248330b768b3cd2cba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:11.764502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:11.776973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b975fc-c0bb-47f8-860f-ba3b0ba3cea9 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:11.842429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:11.843326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:11.843605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:11.843873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] PATH_INFO: `/v3/users/c6f8c65371a0492e92234dce11839d60` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:11.845638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f8c65371a0492e92234dce11839d60)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:11.847726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:11.896207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f8c65371a0492e92234dce11839d60'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.896929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f8c65371a0492e92234dce11839d60'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.897573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f8c65371a0492e92234dce11839d60'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.911191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f8c65371a0492e92234dce11839d60'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.920224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f8c65371a0492e92234dce11839d60'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:11.937697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 943/1878] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:11 2021] DELETE /identity/v3/users/c6f8c65371a0492e92234dce11839d60 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:12.215736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.216245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.216334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.256653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] MFA Rules not processed for user `5df79cdd584947ff967966692375c45c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:12.259030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:12.341840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.343235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:12.386694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 936/1879] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:12 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:12.394538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.396507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:12.444455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829dab5-6273-47ef-a8bb-6b7cfd17e993 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.449273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.450430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.450430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.450720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] PATH_INFO: `/v3/projects/b6af5aa3805a428db367e7a5d253a65c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.451968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6af5aa3805a428db367e7a5d253a65c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.454070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.472728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713565c-ef44-4592-b85c-94c8058e1f5a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.479333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.480085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.480438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.480781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.490552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.492098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987743d-3bfa-49b2-a8be-ebb021188159 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.503558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 937/1880] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:12 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:12.504406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6af5aa3805a428db367e7a5d253a65c', 'request_id': 'req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:12.510140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6af5aa3805a428db367e7a5d253a65c', 'request_id': 'req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:12.517393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6af5aa3805a428db367e7a5d253a65c', 'request_id': 'req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:12.533584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] The token cache is being invalidate because project b6af5aa3805a428db367e7a5d253a65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:12.533883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:12.535414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a3e1f46-f584-4e0a-b0ab-aa65264ad6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:12.538987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 944/1881] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:12 2021] DELETE /identity/v3/projects/b6af5aa3805a428db367e7a5d253a65c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:12.543108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.543565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.543865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.561832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:12.563257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:12.630988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 938/1882] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:12.640515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.641061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.641583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.665924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:12.667171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:12.676976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 945/1883] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:12.681265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.692087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa984308-b579-456b-bb0b-220f752c11f1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.696836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.697530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.697836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.698133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.699180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:12.699496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.701120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.718544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 939/1884] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:41:12.720926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.731067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17b600-739c-4d26-baf6-50b5a2d828fc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.737126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.737793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.738072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.738348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.739097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.741004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.771773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 946/1885] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:12 2021] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:12.776165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.787263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f7522-289a-4611-8c27-f857425fd965 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.854366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.855071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.855354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.855737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.856356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.858238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.880319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 940/1886] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:12 2021] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:41:12.883989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.895109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfae748-2836-44e5-8b0f-ddb6b0bcaa40 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.900484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.901149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.901439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.901726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.902479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.904116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.915757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 947/1887] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:41:12.920094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.931589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f532a-a5e3-4fe0-af9f-c80f2fe0301f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.936417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.937121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.937411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.937736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.938789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.940521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de527ffa-657c-4984-8d1f-d2f9c16bb35b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:12.950958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 941/1888] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:12.955301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:12.965176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb546-67f4-45c8-8298-6afa0a3043c9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:12.970458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:12.971404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:12.971689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:12.972011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] PATH_INFO: `/v3/projects/49c5f3875c214662a4e09a9b25200644/users/eb74790b906e43a58f5729f50b64df8a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:12.987379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c5f3875c214662a4e09a9b25200644, user_id=eb74790b906e43a58f5729f50b64df8a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:12.990050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.003153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 948/1889] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:12 2021] PUT /identity/v3/projects/49c5f3875c214662a4e09a9b25200644/users/eb74790b906e43a58f5729f50b64df8a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:13.013152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.013447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.013753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.040320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] MFA Rules not processed for user `eb74790b906e43a58f5729f50b64df8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:13.041555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:13.108724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 942/1890] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:13 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:13.114713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.176394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560d0e-cb22-4008-972a-38defb674d48 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.186636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.186636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.186636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.186636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.187129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.187129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.224893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 949/1891] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:13 2021] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:13.226112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.237596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024d533-31d7-414b-94d8-d31960bb06ee None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.307571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.308329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.308620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.308902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.309982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.312200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.334408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 943/1892] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:13 2021] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:13.338477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.352025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a903ca0-ab8b-48f5-aa1e-b4995861e5aa admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.357529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.358216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.358528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.358817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.359566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.361461 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.372343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 950/1893] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:13.378284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.388344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b622b0-7344-4ed6-b963-c018464876fa admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.393797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.394742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.395028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.395305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] PATH_INFO: `/v3/projects/359057d633cc47b6b82ea61fae3d2ecd/users/46829696f74148f3945021681b636de2/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.411926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=359057d633cc47b6b82ea61fae3d2ecd, user_id=46829696f74148f3945021681b636de2, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.414645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.432555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 944/1894] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:13 2021] PUT /identity/v3/projects/359057d633cc47b6b82ea61fae3d2ecd/users/46829696f74148f3945021681b636de2/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:13.436301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.447117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c8eb-7da5-4b79-9e64-f04000e54079 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.510398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.511105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.511390 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.511670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.512417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.514022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df41a9-732a-42e3-ba73-4e6474766229 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.524568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 951/1895] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:13 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:13.528810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.539937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b58d-688c-40b5-bec2-63f30e76f388 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.545229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.546173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.546460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.546771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] PATH_INFO: `/v3/projects/359057d633cc47b6b82ea61fae3d2ecd/users/46829696f74148f3945021681b636de2/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.549557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=359057d633cc47b6b82ea61fae3d2ecd, user_id=46829696f74148f3945021681b636de2, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.552313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.563706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 945/1896] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:13 2021] PUT /identity/v3/projects/359057d633cc47b6b82ea61fae3d2ecd/users/46829696f74148f3945021681b636de2/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:13.575994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679016ce-9948-441e-9ebf-f9b0f59f817b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.576319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679016ce-9948-441e-9ebf-f9b0f59f817b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.576558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679016ce-9948-441e-9ebf-f9b0f59f817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.605695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-679016ce-9948-441e-9ebf-f9b0f59f817b None None] MFA Rules not processed for user `46829696f74148f3945021681b636de2`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:13.606957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-679016ce-9948-441e-9ebf-f9b0f59f817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:13.674968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 952/1897] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:13 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:13.685859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.687762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:13.751253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef60bd-f701-48b1-a912-bee259f0c9fc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.755298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.755959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.756246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.756523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.766516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.768074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:13.777972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 946/1898] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:13 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:13.865331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcda8e-8c1f-4e66-aa46-ca5d6fa74486 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.865647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcda8e-8c1f-4e66-aa46-ca5d6fa74486 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.865934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcda8e-8c1f-4e66-aa46-ca5d6fa74486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.884738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-54bcda8e-8c1f-4e66-aa46-ca5d6fa74486 None None] MFA Rules not processed for user `5df79cdd584947ff967966692375c45c`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:13.885982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-54bcda8e-8c1f-4e66-aa46-ca5d6fa74486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:13.908215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:13.947450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 953/1899] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:13 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:13.981754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55e4e2-087a-49c9-8f10-caad39973a22 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:13.987654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:13.988701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:13.988991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:13.989272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] PATH_INFO: `/v3/users/eb74790b906e43a58f5729f50b64df8a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:13.990558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb74790b906e43a58f5729f50b64df8a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:13.992526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:14.042265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb74790b906e43a58f5729f50b64df8a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.043027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb74790b906e43a58f5729f50b64df8a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.050266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb74790b906e43a58f5729f50b64df8a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.061834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb74790b906e43a58f5729f50b64df8a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.069577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb74790b906e43a58f5729f50b64df8a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.075713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 947/1900] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:13 2021] DELETE /identity/v3/users/eb74790b906e43a58f5729f50b64df8a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:14.081398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:14.081583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:14.081867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:14.104961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:14.106217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:14.168111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 954/1901] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:14.178868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:14.180385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:14.247030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbe767-d27d-4a79-b3f1-20b493e6ca50 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:14.250780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:14.252519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:14.252949 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:14.253231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:14.263064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:14.264741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:14.275681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 948/1902] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:14.658107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:14.661097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:14.677281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c42557-1502-448c-894b-0eb8b8155373 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:14.682551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:14.683419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:14.683708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:14.683999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] PATH_INFO: `/v3/projects/49c5f3875c214662a4e09a9b25200644` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:14.685219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c5f3875c214662a4e09a9b25200644)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:14.687300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:14.760440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c5f3875c214662a4e09a9b25200644', 'request_id': 'req-975036ef-c917-4310-9448-4b44caa5d6bf'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.766556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c5f3875c214662a4e09a9b25200644', 'request_id': 'req-975036ef-c917-4310-9448-4b44caa5d6bf'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.773527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c5f3875c214662a4e09a9b25200644', 'request_id': 'req-975036ef-c917-4310-9448-4b44caa5d6bf'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.787171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] The token cache is being invalidate because project 49c5f3875c214662a4e09a9b25200644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:14.787480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.788094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.789665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 955/1903] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:14 2021] DELETE /identity/v3/projects/49c5f3875c214662a4e09a9b25200644 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:14.793579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:14.811977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc06e1-507a-49bf-987d-05b3c05dabb5 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:14.878622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:14.879512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:14.879799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:14.880079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] PATH_INFO: `/v3/users/46829696f74148f3945021681b636de2` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:14.881321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46829696f74148f3945021681b636de2)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:14.883298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:14.934910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46829696f74148f3945021681b636de2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.935785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46829696f74148f3945021681b636de2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.943992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46829696f74148f3945021681b636de2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.957745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46829696f74148f3945021681b636de2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.966175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4acc8a6f-d452-4a7e-a9db-9ec0a72e533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46829696f74148f3945021681b636de2'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:14.973370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 949/1904] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:14 2021] DELETE /identity/v3/users/46829696f74148f3945021681b636de2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:15.258957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.260486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:15.285422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975036ef-c917-4310-9448-4b44caa5d6bf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.356443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.357346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.357639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.357917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] PATH_INFO: `/v3/projects/359057d633cc47b6b82ea61fae3d2ecd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.359210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359057d633cc47b6b82ea61fae3d2ecd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.361903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.414882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359057d633cc47b6b82ea61fae3d2ecd', 'request_id': 'req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:15.420867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359057d633cc47b6b82ea61fae3d2ecd', 'request_id': 'req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:15.427588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359057d633cc47b6b82ea61fae3d2ecd', 'request_id': 'req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:15.440829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] The token cache is being invalidate because project 359057d633cc47b6b82ea61fae3d2ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:15.441127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:15.441778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fc4586f1-d0d0-4f96-9cbf-2fb15a478149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:15.443514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 956/1905] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:15 2021] DELETE /identity/v3/projects/359057d633cc47b6b82ea61fae3d2ecd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:15.449634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.450136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.450272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.468685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:15.470887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:15.531104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 950/1906] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:15.540135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.540422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.540704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.561562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:15.562740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:15.571107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 957/1907] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:15.575390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.585973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3f64-dd42-44d5-b2c8-ffde704c4bab None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.591073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.591753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.592036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.592330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.593062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:15.594535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.595752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.610147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 951/1908] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:41:15.619003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.640459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f16fc-ad08-43f3-a77a-0fafe185298c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.650255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.651277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.651749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.652207 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.653245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.655450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.690713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 958/1909] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:15 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:15.692366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.706188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd19e40-b6de-4435-938a-306d56213aa8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.778068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.778845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.779124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.779399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.780146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.782204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.810027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 952/1910] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:15 2021] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:15.811323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.821617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fecf-c864-4af3-91cd-3f7381441a4f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.826340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.827036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.827324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.827602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.828351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.830035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.841806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 959/1911] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:15.846558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.856939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b75d8-c52b-42db-9bee-c6ce6195f383 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.862813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.863488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.863798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.864079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.865184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.866790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62ac62-62ad-44d2-be7d-1f6566738459 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.880164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 953/1912] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:15 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:41:15.884393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:15.896050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3fb47-779f-4e47-bd56-5d86571e1fe7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:15.901103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:15.901998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.902283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.902589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] PATH_INFO: `/v3/projects/2c577ff27d8e4660a4af1ed540b22112/users/af1335193913410c995d2a0ec2a1b392/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.919867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c577ff27d8e4660a4af1ed540b22112, user_id=af1335193913410c995d2a0ec2a1b392, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:15.922667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:15.938962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 960/1913] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:15 2021] PUT /identity/v3/projects/2c577ff27d8e4660a4af1ed540b22112/users/af1335193913410c995d2a0ec2a1b392/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:15.944559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b830-24dc-4525-9036-6cff15401728 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:15.944853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b830-24dc-4525-9036-6cff15401728 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:15.945131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b830-24dc-4525-9036-6cff15401728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:15.965325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b4d0b830-24dc-4525-9036-6cff15401728 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:15.967183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b4d0b830-24dc-4525-9036-6cff15401728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:16.040586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 954/1914] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:16.051150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:16.053869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:16.114830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b955eb8-5f3c-4c0d-a88e-81c464bfdcba admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:16.120312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:16.121215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:16.121313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:16.121567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:16.136430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:16.136430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8a034-dd81-4de3-8268-9c20a4786afb service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:16.149261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 961/1915] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:16.794978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:16.795911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:16.796753 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:16.826198 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] MFA Rules not processed for user `e0a3f84e4d9b4c77aab465f1e4df493d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:16.830418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:16.929110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 955/1916] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:17.139435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.140262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.140676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.169668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] MFA Rules not processed for user `af1335193913410c995d2a0ec2a1b392`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:17.171387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:17.296246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 962/1917] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:17 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:17.297388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.309924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b21b5-fbfe-4218-9cc8-19d5ae9c0948 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.315160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.316250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.316749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.317263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.318221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.321194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.352680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 956/1918] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:17 2021] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:17.356496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.373981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db394-1740-487d-84bd-5f8a5044c679 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.458455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.459557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.459966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.460339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.461135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.463208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.500464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 963/1919] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:17 2021] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:17.501878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.518660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba50d-fc62-4f32-ace6-1266d7a6ef2f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.526438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.527633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.528189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.529243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.531075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.534459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.551326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 957/1920] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:17 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:17.555858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.566360 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c6db1-c389-4275-a6f6-420bca72e0b2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.571299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.572200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.572518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.572800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] PATH_INFO: `/v3/projects/0384673aabf74580aaa66764e61f8a58/users/b3ca6d90d227432fbc70ac8ecced0c17/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.589242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0384673aabf74580aaa66764e61f8a58, user_id=b3ca6d90d227432fbc70ac8ecced0c17, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.592032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.607484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 964/1921] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:17 2021] PUT /identity/v3/projects/0384673aabf74580aaa66764e61f8a58/users/b3ca6d90d227432fbc70ac8ecced0c17/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:17.612394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.623000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e53408-ae62-412e-a6ba-5e056cb3c0d7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.688798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.689713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.690001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.690284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.691075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.692684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758821-2285-41b6-ad7b-5e3b084c257e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.705189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 958/1922] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:17 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:17.710465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:17.722311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9fdc-475a-4ac5-812b-23ab61e5ced2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:17.727590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:17.728496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:17.728776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:17.729054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] PATH_INFO: `/v3/projects/0384673aabf74580aaa66764e61f8a58/users/b3ca6d90d227432fbc70ac8ecced0c17/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:17.731135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0384673aabf74580aaa66764e61f8a58, user_id=b3ca6d90d227432fbc70ac8ecced0c17, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:17.733803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:17.746727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 965/1923] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:17 2021] PUT /identity/v3/projects/0384673aabf74580aaa66764e61f8a58/users/b3ca6d90d227432fbc70ac8ecced0c17/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:19.019642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:19.020767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:19.021095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:19.066053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] MFA Rules not processed for user `b3ca6d90d227432fbc70ac8ecced0c17`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:19.070008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:19.206165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 959/1924] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:19 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:19.217815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:19.220710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:19.312333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265486f0-4d20-4a69-9254-14d8b1984a31 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:19.317721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:19.318726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:19.319189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:19.319638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:19.386421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:19.387951 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:19.397191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 966/1925] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:21.854998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:21.869354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9e8d-759c-4184-83a4-9931757a0242 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:21.879224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:21.880403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:21.880919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:21.881446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:21.899548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:21.902409 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc7790-4694-4613-82b9-8d3712fef4b3 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:21.922795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 960/1926] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:21 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:33.907799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:33.909242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:33.987654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06613150-f65f-40c2-aba1-5694ec6dd55d service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:33.992345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:33.993227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:33.993509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:33.993788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] PATH_INFO: `/v3/users/3a48d80664ba45babb77c47bdad0cdd8` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:33.995075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a48d80664ba45babb77c47bdad0cdd8)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:33.997045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:34.056517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a48d80664ba45babb77c47bdad0cdd8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:34.057196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a48d80664ba45babb77c47bdad0cdd8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:34.057857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a48d80664ba45babb77c47bdad0cdd8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:34.070710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a48d80664ba45babb77c47bdad0cdd8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:34.082928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a48d80664ba45babb77c47bdad0cdd8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:34.093358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 967/1927] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:33 2021] DELETE /identity/v3/users/3a48d80664ba45babb77c47bdad0cdd8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:34.097675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:34.099781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:34.100073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:34.121351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:34.122905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:34.189258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 961/1928] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:34.200750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:34.202204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:34.285121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba38df-692b-4b80-b508-5720a8b508db admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:34.292674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:34.294316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:34.294785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:34.295073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:34.311946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:34.315734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9c7e9-c9aa-46ab-b8a0-ce1e041a31ef service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:34.328969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 968/1929] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:34.858148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:34.861177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:34.883465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d845c4e-d883-4ed8-ba92-c30ef27ea44c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:34.892079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:34.893962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:34.894719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:34.895388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] PATH_INFO: `/v3/projects/2b7c76f73532419cacbb0b4eff829a6b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:34.897872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7c76f73532419cacbb0b4eff829a6b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:34.902477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:34.995809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7c76f73532419cacbb0b4eff829a6b', 'request_id': 'req-12481d2c-1161-4251-b76e-f9edb9dab162'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.008372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7c76f73532419cacbb0b4eff829a6b', 'request_id': 'req-12481d2c-1161-4251-b76e-f9edb9dab162'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.018431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7c76f73532419cacbb0b4eff829a6b', 'request_id': 'req-12481d2c-1161-4251-b76e-f9edb9dab162'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.042759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] The token cache is being invalidate because project 2b7c76f73532419cacbb0b4eff829a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:35.042946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.044319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-12481d2c-1161-4251-b76e-f9edb9dab162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.047181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 962/1930] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:34 2021] DELETE /identity/v3/projects/2b7c76f73532419cacbb0b4eff829a6b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:35.056893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.057618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.057618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.081880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:35.083706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:35.186071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 969/1931] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:35.201801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.203239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.204257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.263859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:35.267969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:35.286289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 963/1932] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:35.292058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.312829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3dded-9e11-4744-b0e4-3ddbfd9ae68c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.320544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.321689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.322187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.322724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.324152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:35.324710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.327967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.358216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 970/1933] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:41:35.366150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.381467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfed3-40b3-492d-9f4f-790824540bbc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.387806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.388574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.388855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.389343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.390103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.392695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.427853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.430410 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:35.447592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53aaa-06f0-4730-b23a-54f299436df0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.452887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.454374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.455186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.455448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] PATH_INFO: `/v3/users/b4e000da3af24420a5d27011dc2fb95a` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.456770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e000da3af24420a5d27011dc2fb95a)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.458801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.464227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 964/1934] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:41:35.468492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.535359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e000da3af24420a5d27011dc2fb95a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.536457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e000da3af24420a5d27011dc2fb95a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.537400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e000da3af24420a5d27011dc2fb95a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.553998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef201-1b89-403f-a750-bde9bc17b912 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.556338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e000da3af24420a5d27011dc2fb95a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.559045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.559762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.560201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.560487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.561231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.564143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.571120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e000da3af24420a5d27011dc2fb95a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:35.594217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 971/1935] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:35 2021] DELETE /identity/v3/users/b4e000da3af24420a5d27011dc2fb95a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:35.596581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 965/1936] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:35.603994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.605962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:35.686462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646cbc-9155-4fd0-9ac7-9605647fe075 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.691339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.692054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.692340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.692621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.693381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.695080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.708628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 972/1937] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:35 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:35.712858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.724052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bdfc4-8198-48c7-ac8f-69e1df6e642f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.729137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.729834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.730119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.730391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.731245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.732919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ecdb4-024c-4da0-9550-e281d65589e3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.744873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 966/1938] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:41:35.749309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:35.763092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574725a-e0b6-45d5-8cee-a742b1f2a657 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:35.769553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:35.770708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.771069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.771392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] PATH_INFO: `/v3/projects/acce5730450c4669925184044b50eba2/users/1daa41ee9efb47e49bcdc2c0fd45cf16/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.798437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acce5730450c4669925184044b50eba2, user_id=1daa41ee9efb47e49bcdc2c0fd45cf16, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:35.801285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:35.815275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 973/1939] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:35 2021] PUT /identity/v3/projects/acce5730450c4669925184044b50eba2/users/1daa41ee9efb47e49bcdc2c0fd45cf16/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:35.825749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:35.826049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:35.826591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:35.859784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] MFA Rules not processed for user `1daa41ee9efb47e49bcdc2c0fd45cf16`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:35.861787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:35.969797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 967/1940] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:35.975616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.065347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.066875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:36.129436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc989-570f-46fa-a652-6a9249e59c00 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.137533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.138225 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.138633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.138819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.139594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.142295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.166418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076ad0-bbf1-42b3-bb87-70f9956c1490 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.171407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.172476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.173054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.173627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] PATH_INFO: `/v3/projects/4e1ab98d27254ae9b953182c6f2d1fc1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.175820 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1ab98d27254ae9b953182c6f2d1fc1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.178110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.206062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 974/1941] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:35 2021] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:36.211292 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.298435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1ab98d27254ae9b953182c6f2d1fc1', 'request_id': 'req-67a98c76-13ab-4113-b7e1-21b17a52f0c3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:36.311110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1ab98d27254ae9b953182c6f2d1fc1', 'request_id': 'req-67a98c76-13ab-4113-b7e1-21b17a52f0c3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:36.323311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1ab98d27254ae9b953182c6f2d1fc1', 'request_id': 'req-67a98c76-13ab-4113-b7e1-21b17a52f0c3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:36.334444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d41236-300e-4931-aff4-c13a57c329ce admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.354382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] The token cache is being invalidate because project 4e1ab98d27254ae9b953182c6f2d1fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:36.355242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:36.356857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-67a98c76-13ab-4113-b7e1-21b17a52f0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:36.360910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 968/1942] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:36 2021] DELETE /identity/v3/projects/4e1ab98d27254ae9b953182c6f2d1fc1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:36.369218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc57-f955-4f9c-9361-3d9a269fddeb None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.369502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc57-f955-4f9c-9361-3d9a269fddeb None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.370152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc57-f955-4f9c-9361-3d9a269fddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.400222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-11e5dc57-f955-4f9c-9361-3d9a269fddeb None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:36.401609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-11e5dc57-f955-4f9c-9361-3d9a269fddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:36.444831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.446985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.447265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.447543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.450108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.451265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.499918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 969/1943] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:36.510655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 975/1944] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:36.510969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.510969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.511291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.514215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.525701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:36.547649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:36.549141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:36.550455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f2b76-43a2-43d9-8f22-c2a66ccc61f5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.559821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.561465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.562256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.563074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 970/1945] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:36.563643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.564201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.565685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.569158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.578286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa4b6-ab8c-49b0-a043-11f363f571d8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.586541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.588040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.588335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.588618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.590813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:36.591209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.593616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 976/1946] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:36 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:36.593951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.599989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.620978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 971/1947] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:41:36.622006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.632364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1be4e7-df90-41e3-898e-6b01b13f1d9b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.648141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.648784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.649033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.649320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.650074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.651736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.665159 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aa8f7-a559-4e8b-9f4a-8665ef25af7a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.671436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 977/1948] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:36 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:36.682443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.684577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.685474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.685977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.686195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.687055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.690013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.701233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d44b64-c8cf-4217-b555-fff932c97571 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:36.715306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:36.716411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.716800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.717726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] PATH_INFO: `/v3/projects/7338d5dbbecf448e8e7b77a9a7fbc06b/users/f8d7cf79820b45529f2b13f8a57c8136/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.750303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 972/1949] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:36.755222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:36.759628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338d5dbbecf448e8e7b77a9a7fbc06b, user_id=f8d7cf79820b45529f2b13f8a57c8136, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:36.762748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025681-d886-4bc7-92ce-04b0484a6359 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:36.787691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 978/1950] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:36 2021] PUT /identity/v3/projects/7338d5dbbecf448e8e7b77a9a7fbc06b/users/f8d7cf79820b45529f2b13f8a57c8136/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:36.814230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:36.814729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:36.815024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:36.885799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] MFA Rules not processed for user `f8d7cf79820b45529f2b13f8a57c8136`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:36.893110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:36.893425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26a3be-31f8-4d0d-9062-48bd33a54934 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.035841 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 979/1951] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:37.039386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.041024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.042374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.042776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.042935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.043848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.056678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.062201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168482d8-efd5-4ccd-8dd3-1bfb8c4724d3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.067898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.069373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.069662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.069948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.071160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.073518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.131133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 973/1952] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:36 2021] POST /identity/v3/users => generated 289 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:41:37.133450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.160422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029431-a53e-4ffd-a692-171c7789ef66 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.169700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 980/1953] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:37.174181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.174870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.175748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.176481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.177624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.180021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.184740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.208077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 974/1954] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:37.212111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.223294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09034d3-cb27-4554-8ae0-f873d28acb63 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.265145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa2d99-4499-4501-8b59-113de0a535df admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.271959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.272789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.273177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.273555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.274350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.276476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.300125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 981/1955] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:37.304241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.310079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.310910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.311293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.311637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.312488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.315683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.319125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5ab1-6d4c-49aa-bfcc-9572a75602b1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.326519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.329991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 975/1956] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:41:37.330133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.330133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.330133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.330133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.330863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.331271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.343338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 982/1957] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:37.349006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62aaba-2426-4e5d-9a74-c11025d2c349 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.350602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.355037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.356017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.356307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.357685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] PATH_INFO: `/v3/projects/3af77abc60944ce8a580065a082c8f75/users/aa0c5f757cee4375abd8edb790c47f1a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.365925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994dc04-3a77-4087-aeb2-12d30b97b59c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.374624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.376358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.376870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.377245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] PATH_INFO: `/v3/projects/ed1058b282044c2795ab96262b4c762f/users/973ce315144b41e798ab96a9dfc83e00/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.382457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af77abc60944ce8a580065a082c8f75, user_id=aa0c5f757cee4375abd8edb790c47f1a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.385485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.397913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1058b282044c2795ab96262b4c762f, user_id=973ce315144b41e798ab96a9dfc83e00, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.400790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f448-0adb-47e7-8c5e-3ef40c04b421 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.401633 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 976/1958] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:37 2021] PUT /identity/v3/projects/3af77abc60944ce8a580065a082c8f75/users/aa0c5f757cee4375abd8edb790c47f1a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:37.416876 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 983/1959] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:37 2021] PUT /identity/v3/projects/ed1058b282044c2795ab96262b4c762f/users/973ce315144b41e798ab96a9dfc83e00/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:37.420870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.451780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.452070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.452351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.487021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] MFA Rules not processed for user `aa0c5f757cee4375abd8edb790c47f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:37.488418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:37.502546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f27e-b732-4d09-9b15-4267c6c3be2d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.577943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.579241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.579241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.579241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.580052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.582230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.590102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 984/1960] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:37.596376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.607912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 977/1961] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:37.613095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.614227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f864-6742-4b0f-adcf-4243c46f86af None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.626521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.626644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807746a4-4885-4885-84d4-325a5072ef82 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.626735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.626979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.627349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.628659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.632696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba04cf8-fe53-4ee9-81c0-c8d28765aa1f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.647341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.649034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.649932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.650475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] PATH_INFO: `/v3/projects/ed1058b282044c2795ab96262b4c762f/users/973ce315144b41e798ab96a9dfc83e00/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.654237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1058b282044c2795ab96262b4c762f, user_id=973ce315144b41e798ab96a9dfc83e00, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.659397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.677395 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 978/1962] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:37 2021] PUT /identity/v3/projects/ed1058b282044c2795ab96262b4c762f/users/973ce315144b41e798ab96a9dfc83e00/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:37.679808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 985/1963] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:37.688666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.689912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.690640 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.691421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.745402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] MFA Rules not processed for user `973ce315144b41e798ab96a9dfc83e00`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:37.747748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:37.797081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc9396-0e23-414d-ab41-a94bd516e371 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.859281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 986/1964] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:37.871999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.873573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:37.909986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.911610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.912323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.913044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.914916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.920785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:37.960203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 979/1965] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:37 2021] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:37.964644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:37.982262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d17b46-afed-4e93-b27e-079c796102b1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.986159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c8b1a-79ef-4253-b744-98316b532852 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:37.992805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.993946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.994594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.994779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:37.995050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.996673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:37.997071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:37.997560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:37.997991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:37.999620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.001615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:38.048351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 980/1966] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:38.053020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:38.071060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306dedf-8d7c-4434-8d46-7715dd71e6a7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:38.103535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:38.104972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.105352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.105861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] PATH_INFO: `/v3/projects/d2c1985554bd45f18c5f547871b86454/users/5d7cb8733b0e45efaa1ff34b25210525/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.133059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c1985554bd45f18c5f547871b86454, user_id=5d7cb8733b0e45efaa1ff34b25210525, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.136133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.159525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 981/1967] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:38 2021] PUT /identity/v3/projects/d2c1985554bd45f18c5f547871b86454/users/5d7cb8733b0e45efaa1ff34b25210525/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:38.164115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:38.168702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.170285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199320-f373-4bc8-ad4d-d90a4d2d16a2 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.182655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 987/1968] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:37 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:38.220827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453da-6d55-4375-ab28-f35848aa42d5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.220827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453da-6d55-4375-ab28-f35848aa42d5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.221156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9453da-6d55-4375-ab28-f35848aa42d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.241525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0a9453da-6d55-4375-ab28-f35848aa42d5 None None] MFA Rules not processed for user `5df79cdd584947ff967966692375c45c`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:38.243288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0a9453da-6d55-4375-ab28-f35848aa42d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:38.258541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda9da-6a7c-43ca-af01-7d0c85412243 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:38.264919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:38.265762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.266825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.267212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.268044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.269713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.282810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 982/1969] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:38 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:38.287116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:38.314270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237f28b-09be-48ff-86a9-36eae6e15d35 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:38.324382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 988/1970] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:38 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:38.331431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:38.332465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.332866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.333255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] PATH_INFO: `/v3/projects/d2c1985554bd45f18c5f547871b86454/users/5d7cb8733b0e45efaa1ff34b25210525/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.337061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c1985554bd45f18c5f547871b86454, user_id=5d7cb8733b0e45efaa1ff34b25210525, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.340345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.359528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 983/1971] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:38 2021] PUT /identity/v3/projects/d2c1985554bd45f18c5f547871b86454/users/5d7cb8733b0e45efaa1ff34b25210525/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:38.371667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.372795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.372795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.454846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] MFA Rules not processed for user `5d7cb8733b0e45efaa1ff34b25210525`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:38.458721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:38.562772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:38.567506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:38.637833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 989/1972] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:38 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:38.656423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:38.699467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5b3ec-8756-4768-bf0e-669342a129d0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:38.712290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:38.713435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.713722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.714000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] PATH_INFO: `/v3/users/af1335193913410c995d2a0ec2a1b392` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.716419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1335193913410c995d2a0ec2a1b392)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.718465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.727376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ec2a8-f9f3-4520-9e12-4f673a3b490c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:38.732458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:38.732458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:38.732810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:38.732810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:38.802241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1335193913410c995d2a0ec2a1b392'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:38.803071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1335193913410c995d2a0ec2a1b392'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:38.814742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1335193913410c995d2a0ec2a1b392'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:38.826386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1335193913410c995d2a0ec2a1b392'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:38.832047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:38.834202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd7c2-5422-46f1-9bad-333c6b42d98a service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:38.835348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1335193913410c995d2a0ec2a1b392'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:38.845697 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 984/1973] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:38 2021] DELETE /identity/v3/users/af1335193913410c995d2a0ec2a1b392 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:38.846334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 990/1974] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:38 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:39.234264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:39.236475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:39.397264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847690ce-f5a2-4924-bfb1-082e25cc82ea admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:39.413387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:39.413387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:39.413387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:39.413387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] PATH_INFO: `/v3/projects/2c577ff27d8e4660a4af1ed540b22112` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:39.413772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c577ff27d8e4660a4af1ed540b22112)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:39.414881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:39.431968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:39.432512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:39.432512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:39.454169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] MFA Rules not processed for user `e0a3f84e4d9b4c77aab465f1e4df493d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:39.455840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:39.495385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c577ff27d8e4660a4af1ed540b22112', 'request_id': 'req-4163f7a2-9c14-4715-98a1-75df39a1788e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.502520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c577ff27d8e4660a4af1ed540b22112', 'request_id': 'req-4163f7a2-9c14-4715-98a1-75df39a1788e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.508819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c577ff27d8e4660a4af1ed540b22112', 'request_id': 'req-4163f7a2-9c14-4715-98a1-75df39a1788e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.535043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] The token cache is being invalidate because project 2c577ff27d8e4660a4af1ed540b22112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:39.535549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.537612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 991/1975] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:39 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:39.538000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.548539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 985/1976] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:39 2021] DELETE /identity/v3/projects/2c577ff27d8e4660a4af1ed540b22112 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:39.554821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:39.570580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33374e-5d29-452a-a5fc-31e98252a7e9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:39.652066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:39.653364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:39.653961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:39.654255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] PATH_INFO: `/v3/users/b3ca6d90d227432fbc70ac8ecced0c17` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:39.655945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ca6d90d227432fbc70ac8ecced0c17)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:39.663981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:39.809000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ca6d90d227432fbc70ac8ecced0c17'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.811060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ca6d90d227432fbc70ac8ecced0c17'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.815658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ca6d90d227432fbc70ac8ecced0c17'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.837240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ca6d90d227432fbc70ac8ecced0c17'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.853900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ca6d90d227432fbc70ac8ecced0c17'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:39.879910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 992/1977] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:39 2021] DELETE /identity/v3/users/b3ca6d90d227432fbc70ac8ecced0c17 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:40.022520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:40.025317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:40.159715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:40.162071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:40.188799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163f7a2-9c14-4715-98a1-75df39a1788e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:40.311654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703681d9-18d0-43fd-b6b7-701d00807e1a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:40.318444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:40.320676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:40.321669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.321925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.322043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.322218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] PATH_INFO: `/v3/projects/0384673aabf74580aaa66764e61f8a58` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.322335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.322581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.323487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0384673aabf74580aaa66764e61f8a58)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:40.324842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:40.325954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:40.405228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0384673aabf74580aaa66764e61f8a58', 'request_id': 'req-1a18d093-336a-44b5-9d73-4abb4cfe8db6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:40.410692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:40.412419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d2566-66ca-486f-b40b-f77ced90b044 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:40.416386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0384673aabf74580aaa66764e61f8a58', 'request_id': 'req-1a18d093-336a-44b5-9d73-4abb4cfe8db6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:40.424278 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0384673aabf74580aaa66764e61f8a58', 'request_id': 'req-1a18d093-336a-44b5-9d73-4abb4cfe8db6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:40.426218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 986/1978] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:40.447438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] The token cache is being invalidate because project 0384673aabf74580aaa66764e61f8a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:40.448022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:40.448592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1a18d093-336a-44b5-9d73-4abb4cfe8db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:40.450977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 993/1979] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:40 2021] DELETE /identity/v3/projects/0384673aabf74580aaa66764e61f8a58 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:41:40.457419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.457814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.458159 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.482256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:40.484391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:40.621032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 987/1980] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:41:40.629705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.630744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.631033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.663761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:40.666445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:40.681285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 994/1981] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:40.683086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:40.699984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64fa30-79c6-4ee4-95c3-ecddc5bc1a4e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:40.707548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:40.708244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.708600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.708883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.709560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:40.710567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:40.716671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:40.743252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 988/1982] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:41:40.743733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:40.760007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a457d6-2274-4a0a-a8b7-8eaef9485821 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:40.773312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:40.774180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.774538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.774820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.775570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:40.777532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:40.826231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 995/1983] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:40 2021] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:41:40.830457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:40.841769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b8f79-1a75-46d2-b895-c3e33a70afcc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:40.993232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:40.994331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:40.995054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:40.995412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:40.997095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:40.999628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.038130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 989/1984] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:40 2021] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:41.039580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.055629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a49115-1008-41ae-9d88-e9c6f513268c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.067328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.068030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.068315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.068598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.069418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.071122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.089008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.094472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 996/1985] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:41.104717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39b89-d79d-4718-b9c0-9923672fe2f2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.112517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.113063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.113423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.113775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.114760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.116909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732a8c0-7a2c-4e29-bd98-475effdb4a70 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.144459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.145858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 990/1986] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:41 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:41.160517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712dba-9d1c-4b65-9f4d-cc34added7f1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.178112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.180242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.180846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.181426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] PATH_INFO: `/v3/projects/be2e23a503ea434ba83f695bf071fea7/users/0d17d540ab344abc9d2fcbb6e91ddc31/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.214931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2e23a503ea434ba83f695bf071fea7, user_id=0d17d540ab344abc9d2fcbb6e91ddc31, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.218432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.249704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 997/1987] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:41 2021] PUT /identity/v3/projects/be2e23a503ea434ba83f695bf071fea7/users/0d17d540ab344abc9d2fcbb6e91ddc31/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:41.270777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.271541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.272264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.326252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] MFA Rules not processed for user `0d17d540ab344abc9d2fcbb6e91ddc31`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:41.327873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:41.356105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.358242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:41.442019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 991/1988] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:41 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:41.462951 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cea7b-6ecc-4413-b7a4-c39043a3a2c3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.469562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.470257 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.470569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.470853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.472753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:41.566710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.568423 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.596616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 998/1989] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:41 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:41.651175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.654301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:41.707005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc91ff6-52c8-4260-a16e-429ab1ef5edc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.714740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.715781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.716833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.717316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.734545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.736846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6746365-260b-4721-9294-dccd23f9f40e service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.778832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 992/1990] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:41 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:41.797435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:41.877554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce215277-e380-46ac-94aa-33ee24f57224 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:41.882765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:41.883824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:41.884117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:41.884476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] PATH_INFO: `/v3/users/0d17d540ab344abc9d2fcbb6e91ddc31` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:41.885849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d17d540ab344abc9d2fcbb6e91ddc31)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:41.887950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:41.972317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d17d540ab344abc9d2fcbb6e91ddc31'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:41.973330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d17d540ab344abc9d2fcbb6e91ddc31'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:41.974460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d17d540ab344abc9d2fcbb6e91ddc31'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:41.994334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d17d540ab344abc9d2fcbb6e91ddc31'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:42.008623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d17d540ab344abc9d2fcbb6e91ddc31'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:42.028985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 999/1991] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:41 2021] DELETE /identity/v3/users/0d17d540ab344abc9d2fcbb6e91ddc31 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:42.033901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:42.034218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:42.034531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:42.065219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:42.066472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:42.139265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 993/1992] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:42.149914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:42.151416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:42.239495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0833bf-014f-424e-bfc8-6ce36da8334b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:42.244006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:42.245090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:42.245558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:42.246124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:42.257523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:42.259280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:42.271338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1000/1993] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:42.852632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:42.854607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:42.876323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174ca2-cfac-4bed-bff0-1f85ed0883a9 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:42.894106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:42.895025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:42.895306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:42.895629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] PATH_INFO: `/v3/projects/be2e23a503ea434ba83f695bf071fea7` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:42.896799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2e23a503ea434ba83f695bf071fea7)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:42.898786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:42.973501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2e23a503ea434ba83f695bf071fea7', 'request_id': 'req-77493034-a03c-4010-9b13-167bad59d9df'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:42.980421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2e23a503ea434ba83f695bf071fea7', 'request_id': 'req-77493034-a03c-4010-9b13-167bad59d9df'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:42.987363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2e23a503ea434ba83f695bf071fea7', 'request_id': 'req-77493034-a03c-4010-9b13-167bad59d9df'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:43.008103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] The token cache is being invalidate because project be2e23a503ea434ba83f695bf071fea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:43.008618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:43.009668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:43.012581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 994/1994] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:42 2021] DELETE /identity/v3/projects/be2e23a503ea434ba83f695bf071fea7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:46.865504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:46.867713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:46.926974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f638e-f8c3-4f58-8185-9314468f55ca service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:47.000754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c954146-0724-4289-a331-d0175243facb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:47.002282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954146-0724-4289-a331-d0175243facb service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:47.002602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954146-0724-4289-a331-d0175243facb service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:47.002880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954146-0724-4289-a331-d0175243facb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:47.005002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7c954146-0724-4289-a331-d0175243facb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:47.109377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c954146-0724-4289-a331-d0175243facb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:47.111391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c954146-0724-4289-a331-d0175243facb service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:47.124418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1001/1995] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:46 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:41:55.253156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:55.254724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:55.318772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77493034-a03c-4010-9b13-167bad59d9df admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:55.323433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:55.324298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:55.324581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:55.324862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] PATH_INFO: `/v3/users/1daa41ee9efb47e49bcdc2c0fd45cf16` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:55.326096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1daa41ee9efb47e49bcdc2c0fd45cf16)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:55.328575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:55.373479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1daa41ee9efb47e49bcdc2c0fd45cf16'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:55.374136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1daa41ee9efb47e49bcdc2c0fd45cf16'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:55.381263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1daa41ee9efb47e49bcdc2c0fd45cf16'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:55.394210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1daa41ee9efb47e49bcdc2c0fd45cf16'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:55.402205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1daa41ee9efb47e49bcdc2c0fd45cf16'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:55.409830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 995/1996] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:55 2021] DELETE /identity/v3/users/1daa41ee9efb47e49bcdc2c0fd45cf16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:55.414802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:55.415338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:55.415338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:55.433337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:55.434591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:55.508210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1002/1997] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:55.518848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:55.520255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:55.579664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1c89-e720-4312-89d3-de0fdde0db4e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:55.583764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:55.584433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:55.584934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:55.585219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:55.595042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:55.597281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:55.608302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 996/1998] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:41:55.976433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:55.980431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:56.001963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03d3d-1217-477e-8e01-581110f2ee02 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:56.008085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:56.009531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:56.010072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:56.010651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] PATH_INFO: `/v3/projects/acce5730450c4669925184044b50eba2` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:56.012214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acce5730450c4669925184044b50eba2)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:56.018409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:56.086062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acce5730450c4669925184044b50eba2', 'request_id': 'req-2bafb7ae-a927-4497-b117-a4f4e8d430e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.092478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acce5730450c4669925184044b50eba2', 'request_id': 'req-2bafb7ae-a927-4497-b117-a4f4e8d430e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.100231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acce5730450c4669925184044b50eba2', 'request_id': 'req-2bafb7ae-a927-4497-b117-a4f4e8d430e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.114316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] The token cache is being invalidate because project acce5730450c4669925184044b50eba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:56.114657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.115297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.116854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1003/1999] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:55 2021] DELETE /identity/v3/projects/acce5730450c4669925184044b50eba2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:56.122151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:56.135201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409e2e-4927-4235-8e7c-772e4fcfbd7f service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:56.194001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:56.194923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:56.195210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:56.195487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] PATH_INFO: `/v3/users/f8d7cf79820b45529f2b13f8a57c8136` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:56.196870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8d7cf79820b45529f2b13f8a57c8136)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:56.198941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:56.245165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8d7cf79820b45529f2b13f8a57c8136'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.245715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8d7cf79820b45529f2b13f8a57c8136'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.253077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8d7cf79820b45529f2b13f8a57c8136'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.266318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8d7cf79820b45529f2b13f8a57c8136'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.274175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8d7cf79820b45529f2b13f8a57c8136'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.280377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 997/2000] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:56 2021] DELETE /identity/v3/users/f8d7cf79820b45529f2b13f8a57c8136 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:56.571285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:56.574088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:56.590050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafb7ae-a927-4497-b117-a4f4e8d430e7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:56.651639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:56.652509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:56.652853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:56.653069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] PATH_INFO: `/v3/projects/7338d5dbbecf448e8e7b77a9a7fbc06b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:56.654276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7338d5dbbecf448e8e7b77a9a7fbc06b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:56.656592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:56.703938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7338d5dbbecf448e8e7b77a9a7fbc06b', 'request_id': 'req-6b1291ac-b42d-406a-bdd2-a29b5445c539'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.709383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7338d5dbbecf448e8e7b77a9a7fbc06b', 'request_id': 'req-6b1291ac-b42d-406a-bdd2-a29b5445c539'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.715592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7338d5dbbecf448e8e7b77a9a7fbc06b', 'request_id': 'req-6b1291ac-b42d-406a-bdd2-a29b5445c539'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.728405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] The token cache is being invalidate because project 7338d5dbbecf448e8e7b77a9a7fbc06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:56.728672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.729293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.730869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1004/2001] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:56 2021] DELETE /identity/v3/projects/7338d5dbbecf448e8e7b77a9a7fbc06b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:56.734959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:56.736376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:56.748955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91a04-4c74-4cea-9876-33bf524509bf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:56.805226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:56.806094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:56.806384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:56.806704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] PATH_INFO: `/v3/users/973ce315144b41e798ab96a9dfc83e00` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:56.807915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=973ce315144b41e798ab96a9dfc83e00)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:56.809852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:56.861749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973ce315144b41e798ab96a9dfc83e00'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.862973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973ce315144b41e798ab96a9dfc83e00'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.871612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973ce315144b41e798ab96a9dfc83e00'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.883998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973ce315144b41e798ab96a9dfc83e00'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.893223 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-af4e2487-6611-438f-ad38-6b87b20eb55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973ce315144b41e798ab96a9dfc83e00'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:56.899964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 998/2002] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:41:56 2021] DELETE /identity/v3/users/973ce315144b41e798ab96a9dfc83e00 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:57.221366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.223561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:57.236095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1291ac-b42d-406a-bdd2-a29b5445c539 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.300685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.301710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.302063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.302407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] PATH_INFO: `/v3/projects/ed1058b282044c2795ab96262b4c762f` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.303725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1058b282044c2795ab96262b4c762f)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.305692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.355949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1058b282044c2795ab96262b4c762f', 'request_id': 'req-4c78c631-c124-4a48-a747-789cd3249a58'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:57.362739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1058b282044c2795ab96262b4c762f', 'request_id': 'req-4c78c631-c124-4a48-a747-789cd3249a58'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:57.370792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1058b282044c2795ab96262b4c762f', 'request_id': 'req-4c78c631-c124-4a48-a747-789cd3249a58'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:57.385038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] The token cache is being invalidate because project ed1058b282044c2795ab96262b4c762f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:41:57.385327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:57.385942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c78c631-c124-4a48-a747-789cd3249a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:41:57.387509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1005/2003] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:41:57 2021] DELETE /identity/v3/projects/ed1058b282044c2795ab96262b4c762f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:57.393286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.393762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.393877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.415699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:57.416932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:57.479542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 999/2004] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:57.488547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.488874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.489162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.511398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:57.512679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:57.520844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1006/2005] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:57.525386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.535347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac0b10-a08f-401d-85cb-f5c444615f85 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.540005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.540674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.540959 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.541235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.542020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:41:57.542326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.544001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.557141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1000/2006] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:41:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:41:57.561486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.572055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c43a8-f167-46eb-bbde-7ad8cdda174d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.576958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.577699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.578026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.578420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.579185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.581126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.607256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1007/2007] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:41:57 2021] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:57.613387 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.623872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d45573-51ed-4d69-9f12-4acfdb2d47ec admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.702483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.704602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.704962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.705269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.706363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.708367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.729185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1001/2008] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:41:57 2021] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:41:57.733733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.745276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f6257-b8a8-407d-822b-6c96dcb21453 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.751088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.751755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.752051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.752303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.753050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.754691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.766064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1008/2009] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:57.770311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.780287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2719-8e8e-4202-b120-eab918fb7409 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.786183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.786879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.787166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.787445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.788197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.789793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864d20f-8269-49fc-82c4-d7bb22b061fb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.800803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1002/2010] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:41:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:41:57.804971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.815069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f25-bbb3-4374-9426-a6b6c9c184b9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:57.819713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:57.820614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.820901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.821202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] PATH_INFO: `/v3/projects/a7369d7f1ce548ca83f25ccfa1c518de/users/5297078807fd4a9bb4c3e56ba258f22e/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.835318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7369d7f1ce548ca83f25ccfa1c518de, user_id=5297078807fd4a9bb4c3e56ba258f22e, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:57.837971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:57.852622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1009/2011] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:41:57 2021] PUT /identity/v3/projects/a7369d7f1ce548ca83f25ccfa1c518de/users/5297078807fd4a9bb4c3e56ba258f22e/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:41:57.864288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:57.864580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:57.864894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:57.892531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] MFA Rules not processed for user `5297078807fd4a9bb4c3e56ba258f22e`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:41:57.893742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:57.958618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1003/2012] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:41:57 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:41:57.969069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:41:57.970783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:41:58.027003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31d323-7c03-4aa8-8fb8-6a9c7ce0351b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:41:58.031277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:41:58.031968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:41:58.032345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:41:58.032628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:41:58.041237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:41:58.042780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49569380-fb7d-473e-8496-69a559735e04 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:41:58.053066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1010/2013] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:41:57 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:45.083901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:45.189813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2c7e2-d15f-46e9-8653-c5fe75737d32 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:45.194701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:45.195574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:45.195857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:45.196135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] PATH_INFO: `/v3/users/5297078807fd4a9bb4c3e56ba258f22e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:45.197361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5297078807fd4a9bb4c3e56ba258f22e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:45.200056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:45.248610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5297078807fd4a9bb4c3e56ba258f22e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.249414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5297078807fd4a9bb4c3e56ba258f22e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.256887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5297078807fd4a9bb4c3e56ba258f22e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.271413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5297078807fd4a9bb4c3e56ba258f22e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.278968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5297078807fd4a9bb4c3e56ba258f22e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.286524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1004/2014] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:42:45 2021] DELETE /identity/v3/users/5297078807fd4a9bb4c3e56ba258f22e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:45.291137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:45.291613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:45.291746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:45.338771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:45.339996 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:45.399918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1011/2015] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:45.410468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:45.411972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:45.507065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc67e70-e485-4841-9dd1-521144547c85 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:45.510856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:45.511536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:45.511845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:45.512099 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:45.521744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:45.523228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd8cf-6424-42be-aba7-132e27fc41f0 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:45.533730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1005/2016] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:45.797702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:45.799208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:45.811173 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf328ec1-3416-4e89-9220-88250440f472 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:45.816370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:45.817235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:45.817520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:45.817933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] PATH_INFO: `/v3/projects/a7369d7f1ce548ca83f25ccfa1c518de` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:45.819569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7369d7f1ce548ca83f25ccfa1c518de)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:45.821527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:45.868019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7369d7f1ce548ca83f25ccfa1c518de', 'request_id': 'req-437551cc-b89c-45a0-95a9-947981abb8c4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.873211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7369d7f1ce548ca83f25ccfa1c518de', 'request_id': 'req-437551cc-b89c-45a0-95a9-947981abb8c4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.880937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7369d7f1ce548ca83f25ccfa1c518de', 'request_id': 'req-437551cc-b89c-45a0-95a9-947981abb8c4'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.894711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] The token cache is being invalidate because project a7369d7f1ce548ca83f25ccfa1c518de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:42:45.895006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.895853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:45.897615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1012/2017] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:42:45 2021] DELETE /identity/v3/projects/a7369d7f1ce548ca83f25ccfa1c518de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:51.166661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:51.167186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:51.167266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:51.201987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:51.203254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:51.268208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1006/2018] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:42:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:51.312226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:51.313650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:51.385114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437551cc-b89c-45a0-95a9-947981abb8c4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:51.391141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:51.391788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:51.392065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:51.392340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:51.400384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:51.402062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d177d-3f16-4ed4-84d6-6bbe4a4ad177 service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:51.410811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1013/2019] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:42:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:42:51.560582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:51.562085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:51.633482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62434af3-362d-4e24-b788-6f7acc0f3e08 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:51.640039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:51.641187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:51.641708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:51.642077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] PATH_INFO: `/v3/users/aa0c5f757cee4375abd8edb790c47f1a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:51.643453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0c5f757cee4375abd8edb790c47f1a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:51.645477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:51.701546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0c5f757cee4375abd8edb790c47f1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:51.704072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0c5f757cee4375abd8edb790c47f1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:51.714302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0c5f757cee4375abd8edb790c47f1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:51.732061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0c5f757cee4375abd8edb790c47f1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:51.745670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0c5f757cee4375abd8edb790c47f1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:51.757734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1007/2020] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:42:51 2021] DELETE /identity/v3/users/aa0c5f757cee4375abd8edb790c47f1a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:51.759389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:51.759677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:51.759956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:51.798024 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:51.799845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:51.880863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1014/2021] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:51.887724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:51.889273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:51.982593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8102f3-3106-48e3-aa16-99410380b1f6 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:51.988041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:51.988773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:51.989313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:51.989600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:52.001301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:52.002825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:52.017163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1008/2022] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:42:52.428906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:52.430744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:52.452269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fee4a-d143-45a2-9f6e-97ffb0dae276 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:52.472411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:52.473054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:52.474065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:52.474468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] PATH_INFO: `/v3/projects/3af77abc60944ce8a580065a082c8f75` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:52.476655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af77abc60944ce8a580065a082c8f75)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:52.479500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:52.561975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af77abc60944ce8a580065a082c8f75', 'request_id': 'req-00a22a8d-c736-41eb-8ffa-f7eba15c1345'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.569152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af77abc60944ce8a580065a082c8f75', 'request_id': 'req-00a22a8d-c736-41eb-8ffa-f7eba15c1345'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.579286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af77abc60944ce8a580065a082c8f75', 'request_id': 'req-00a22a8d-c736-41eb-8ffa-f7eba15c1345'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.600132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] The token cache is being invalidate because project 3af77abc60944ce8a580065a082c8f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:42:52.600439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.601218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.609709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1015/2023] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:42:52 2021] DELETE /identity/v3/projects/3af77abc60944ce8a580065a082c8f75 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:52.614542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:52.626929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b0f23-8bfe-431c-89a9-15d20a782318 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:52.726630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:52.727857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:52.728343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:52.728828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] PATH_INFO: `/v3/users/5d7cb8733b0e45efaa1ff34b25210525` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:52.730321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7cb8733b0e45efaa1ff34b25210525)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:52.732758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:52.813640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7cb8733b0e45efaa1ff34b25210525'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.814414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7cb8733b0e45efaa1ff34b25210525'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.823349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7cb8733b0e45efaa1ff34b25210525'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.837930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7cb8733b0e45efaa1ff34b25210525'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.850265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1a67fdb5-eb59-4513-bed4-09a2c5614928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7cb8733b0e45efaa1ff34b25210525'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:52.862547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1009/2024] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:42:52 2021] DELETE /identity/v3/users/5d7cb8733b0e45efaa1ff34b25210525 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:53.485730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:53.488116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:53.504385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a22a8d-c736-41eb-8ffa-f7eba15c1345 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:53.580182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:53.581399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:53.581682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:53.582143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] PATH_INFO: `/v3/projects/d2c1985554bd45f18c5f547871b86454` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:53.583694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c1985554bd45f18c5f547871b86454)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:53.587493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:53.673955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c1985554bd45f18c5f547871b86454', 'request_id': 'req-7644dcbc-323e-4cb6-bc01-023329755bc3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:53.687868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c1985554bd45f18c5f547871b86454', 'request_id': 'req-7644dcbc-323e-4cb6-bc01-023329755bc3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:53.708592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c1985554bd45f18c5f547871b86454', 'request_id': 'req-7644dcbc-323e-4cb6-bc01-023329755bc3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:53.772702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] The token cache is being invalidate because project d2c1985554bd45f18c5f547871b86454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:42:53.773318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:53.774194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7644dcbc-323e-4cb6-bc01-023329755bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:53.788440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:53.789485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:53.790083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:53.792290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1016/2025] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:42:53 2021] DELETE /identity/v3/projects/d2c1985554bd45f18c5f547871b86454 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:53.908020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:53.909569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:53.999939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.000498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.000936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.003208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1010/2026] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:54.025701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:54.027093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:54.036518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1017/2027] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:54.041056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.055543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e9a8-62f7-45ad-8654-5c983be9dd10 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.060246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.061191 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.061381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.061636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.062389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:42:54.062720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.064316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.088866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1011/2028] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:42:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:42:54.098122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.116976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6e39-75b8-420d-9706-525acc895b10 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.122975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.123682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.124033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.124235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.125076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.127175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.161267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1018/2029] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:42:54.162256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.172970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21622738-7f02-4bf4-8ff4-e29e9fbd1fda admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.255183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.256211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.256534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.256817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.257541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.259523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.288289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1012/2030] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:42:54.291745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.328189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf659ce-35ac-4cc7-a819-c923fbc05e9d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.333966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.334743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.335404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.335742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.336561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.338255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.360286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1019/2031] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:42:54 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:42:54.361842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.373171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57a173-bee6-43df-9994-c935cbaf36a5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.381310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.382854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.383143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.383429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.384190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.385819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c24c6-7a42-4de5-a676-497669cdcd58 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.399333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1013/2032] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:42:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:42:54.403831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.426559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca3e5-411b-4def-a956-58155f199d0f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.448188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.449361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.449724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.450089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] PATH_INFO: `/v3/projects/f003165a35a94ee69fd41e7da2790a35/users/29ec7f006bec420780239722da6cad7d/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.465612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.466013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.467006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.477781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f003165a35a94ee69fd41e7da2790a35, user_id=29ec7f006bec420780239722da6cad7d, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.484249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1c8d-1c95-4118-b110-f287314790f9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.495064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] MFA Rules not processed for user `e0a3f84e4d9b4c77aab465f1e4df493d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:54.496791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:54.508123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1020/2033] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:42:54 2021] PUT /identity/v3/projects/f003165a35a94ee69fd41e7da2790a35/users/29ec7f006bec420780239722da6cad7d/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:54.521032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.521796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.522485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.572066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] MFA Rules not processed for user `29ec7f006bec420780239722da6cad7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:54.573509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:54.582616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1014/2034] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:42:54.656144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1021/2035] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:54.657654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.753721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3629637-68db-4bec-83c5-c1ddb5cce848 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.766858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.767677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.769106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.769489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.770073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.776046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.816213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1015/2036] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:42:54.818387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.832831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58b449-76ce-4550-ac5a-52c22c3d821f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.911888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.912888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.913344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.913784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.914693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.916810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:54.946328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1022/2037] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:42:54 2021] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:42:54.951905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:54.966793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec2c4f-c775-4845-9e46-3851daa2b4a8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:54.978587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:54.979462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:54.979754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:54.980027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:54.980845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:54.984700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.002581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1016/2038] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:42:54 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:42:55.004839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:55.020066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922db289-9692-4eca-bec0-108b3b99d098 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:55.025060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:55.026110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.026230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.026529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] PATH_INFO: `/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c/users/a6c4fc4a7eb04f799921f45d7d5f1165/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.088408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c7e12b616e4fb8b3520d50fd0d6d2c, user_id=a6c4fc4a7eb04f799921f45d7d5f1165, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:55.095866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.173392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1023/2039] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:42:55 2021] PUT /identity/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c/users/a6c4fc4a7eb04f799921f45d7d5f1165/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:55.177739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:55.189394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e537916-a8ac-42ce-8952-a57b318682da admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:55.277145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:55.278071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.278582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.279021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.280501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:55.282436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24194411-91ab-4c71-828c-9e3e2a90e40c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.298889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1017/2040] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:42:55 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:42:55.299649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:55.314369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3874-c1fc-4d3f-af63-c3f7fa67a066 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:55.326323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:55.328302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.328916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.330119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] PATH_INFO: `/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c/users/a6c4fc4a7eb04f799921f45d7d5f1165/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.334695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c7e12b616e4fb8b3520d50fd0d6d2c, user_id=a6c4fc4a7eb04f799921f45d7d5f1165, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:55.338566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.353224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1024/2041] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:42:55 2021] PUT /identity/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c/users/a6c4fc4a7eb04f799921f45d7d5f1165/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:55.365803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4508-1022-4502-a19b-3394a1935929 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.365803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4508-1022-4502-a19b-3394a1935929 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.365803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4508-1022-4502-a19b-3394a1935929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.399192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-958d4508-1022-4502-a19b-3394a1935929 None None] MFA Rules not processed for user `a6c4fc4a7eb04f799921f45d7d5f1165`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:55.400629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-958d4508-1022-4502-a19b-3394a1935929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:55.489295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1018/2042] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:55 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:42:55.501245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:55.503768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:55.615526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b7577-3c06-4934-91ff-e2565ee7ce33 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:55.620284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:55.621017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.621721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.622274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.638399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:55.641160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.653448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1025/2043] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:55 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:55.705627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4508-1022-4502-a19b-3394a1935929 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:55.708162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-958d4508-1022-4502-a19b-3394a1935929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:55.728644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4508-1022-4502-a19b-3394a1935929 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:55.734864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:55.735617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:55.736076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:55.736439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:55.800989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:55.802586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:55.812681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1019/2044] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:55 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:57.090260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:57.098983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:57.151992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:57.154254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:57.221139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487ba09-f052-420e-a993-0bebe265d5b8 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:57.229403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:57.230154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:57.230546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:57.230909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:57.233837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:42:57.250745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:57.252622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:57.266351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1026/2045] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:57.297435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7d44-7aa2-4451-aa29-406a8df3789a service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:57.303202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:57.303890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:57.304180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:57.304458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:57.314291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:57.316066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc2d13-8cd0-4926-9868-888b9442499b service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:57.334289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1020/2046] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:42:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:42:59.583371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:42:59.680937 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f901b-7a96-4235-978f-84b63c10985f service placement] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:42:59.689223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:42:59.690258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:59.690597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:59.690884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] PATH_INFO: `/v3/users/29ec7f006bec420780239722da6cad7d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:59.692202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ec7f006bec420780239722da6cad7d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:42:59.694316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:42:59.754839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ec7f006bec420780239722da6cad7d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:59.756018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ec7f006bec420780239722da6cad7d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:59.756837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ec7f006bec420780239722da6cad7d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:59.771319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ec7f006bec420780239722da6cad7d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:59.781578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ec7f006bec420780239722da6cad7d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:42:59.797612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1027/2047] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:42:59 2021] DELETE /identity/v3/users/29ec7f006bec420780239722da6cad7d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:42:59.802243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:42:59.803209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:42:59.803692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:42:59.837653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:42:59.839562 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:00.117429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1021/2048] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:42:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:00.140105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:00.141902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:00.289960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d46f37-2f34-4a2c-90ee-863185544e67 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:00.305320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:00.307657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:00.308112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:00.308458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:00.322456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:00.324085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:00.352668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1028/2049] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:43:00.708873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:00.711169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:00.727571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3477e9-240e-4222-b736-2883c83d2cae None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:00.733135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:00.734379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:00.735051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:00.735480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] PATH_INFO: `/v3/projects/f003165a35a94ee69fd41e7da2790a35` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:00.736913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f003165a35a94ee69fd41e7da2790a35)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:00.739258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:00.818870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f003165a35a94ee69fd41e7da2790a35', 'request_id': 'req-dc335961-5072-450b-86c2-d8a22a1b4c24'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:00.827342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f003165a35a94ee69fd41e7da2790a35', 'request_id': 'req-dc335961-5072-450b-86c2-d8a22a1b4c24'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:00.834102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f003165a35a94ee69fd41e7da2790a35', 'request_id': 'req-dc335961-5072-450b-86c2-d8a22a1b4c24'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:00.850659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] The token cache is being invalidate because project f003165a35a94ee69fd41e7da2790a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:00.851245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:00.853251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:00.855133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1022/2050] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:00 2021] DELETE /identity/v3/projects/f003165a35a94ee69fd41e7da2790a35 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:00.863173 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:00.877786 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bf358-2339-4397-8f83-df277e715345 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:01.019814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:01.020768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:01.021257 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:01.021540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] PATH_INFO: `/v3/users/a6c4fc4a7eb04f799921f45d7d5f1165` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:01.022890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c4fc4a7eb04f799921f45d7d5f1165)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:01.024880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:01.120670 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c4fc4a7eb04f799921f45d7d5f1165'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.121637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c4fc4a7eb04f799921f45d7d5f1165'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.122399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c4fc4a7eb04f799921f45d7d5f1165'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.154728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c4fc4a7eb04f799921f45d7d5f1165'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.173724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8392ced8-fd30-4125-9464-314dc062af23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c4fc4a7eb04f799921f45d7d5f1165'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.205469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1029/2051] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:00 2021] DELETE /identity/v3/users/a6c4fc4a7eb04f799921f45d7d5f1165 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:01.703328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:01.704885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:01.723183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc335961-5072-450b-86c2-d8a22a1b4c24 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:01.841027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:01.842561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:01.842980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:01.843364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] PATH_INFO: `/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:01.846247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c7e12b616e4fb8b3520d50fd0d6d2c)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:01.848565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:01.929886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c7e12b616e4fb8b3520d50fd0d6d2c', 'request_id': 'req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.938350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c7e12b616e4fb8b3520d50fd0d6d2c', 'request_id': 'req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.946060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c7e12b616e4fb8b3520d50fd0d6d2c', 'request_id': 'req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.963583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] The token cache is being invalidate because project 49c7e12b616e4fb8b3520d50fd0d6d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:01.964258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.965221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-70ac81aa-dfde-4807-9e0f-56f8ba83b8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:01.968204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1023/2052] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:01 2021] DELETE /identity/v3/projects/49c7e12b616e4fb8b3520d50fd0d6d2c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:01.974899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:01.975802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:01.976229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:01.999715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:02.001220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:02.089346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1030/2053] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:02.100048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.100804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.101253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.121666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:02.122889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:02.133422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1024/2054] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:02.137325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.147149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6bd85-7d9d-47f3-8456-030d68704ce9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.159374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.160838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.161182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.161422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.165724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:43:02.166540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.167704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.185583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1031/2055] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:43:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:43:02.187475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.199829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303093-8d1b-4ea5-96a0-c75bfaaa41bc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.205499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.206143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.206420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.206766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.207431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.209344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.242548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1025/2056] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:02.245924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.261561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ebb94-0b37-440e-91aa-8ae413220341 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.351464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.352144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.352567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.352848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.353569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.355812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.391625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1032/2057] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:02.392209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.407684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2aad9-f889-4afe-aebb-2e4e2b0a025f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.413515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.414421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.414991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.415445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.416368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.418717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.432840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1026/2058] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:02 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:02.438332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.459451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c66b1-93a7-4858-a695-b0fb73c0df1e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.477510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.478186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.478624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.478975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.479759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.481696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f03bad-803c-4bfd-a677-9ff85e3d1622 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.497802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1033/2059] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:02 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:02.502334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.514796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310638cc-d87f-42e5-af31-b917b097253a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.521318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.522056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.522329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.522642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] PATH_INFO: `/v3/projects/9c867bee79c64a2b91892a479cb7deb1/users/4b6bd2bec83948f4934bade48d121607/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.543673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c867bee79c64a2b91892a479cb7deb1, user_id=4b6bd2bec83948f4934bade48d121607, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.547590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.564551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1027/2060] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:02 2021] PUT /identity/v3/projects/9c867bee79c64a2b91892a479cb7deb1/users/4b6bd2bec83948f4934bade48d121607/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:02.576012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.576857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.577128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.621771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] MFA Rules not processed for user `4b6bd2bec83948f4934bade48d121607`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:02.624573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:02.718611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1034/2061] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:02.720532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.806570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32ddc7-5f5f-4456-b038-0364a0ed3ce9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:02.813450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:02.814135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:02.814417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:02.814727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:02.815463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:02.817405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:02.852156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1028/2062] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:02.860961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:02.871330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cff03-6bb5-4937-81cd-d39d4d183029 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.007845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.008651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.009244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.009537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.010284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.012434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.053145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1035/2063] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:43:02 2021] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:43:03.054985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.076772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce8e6f-53bb-46f3-ba1a-8a69a014af3c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.090229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.095371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.096229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.096515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.097617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.099321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.113735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1029/2064] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:03 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:03.114949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.125745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8478-af81-4b51-9242-95dd494256e3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.131027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.131900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.132182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.132453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] PATH_INFO: `/v3/projects/b8ed994d22e3497383246678b6bab588/users/0ab495a93501475ebbb46dffeb80768e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.160086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ed994d22e3497383246678b6bab588, user_id=0ab495a93501475ebbb46dffeb80768e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.164605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.182163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1036/2065] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:03 2021] PUT /identity/v3/projects/b8ed994d22e3497383246678b6bab588/users/0ab495a93501475ebbb46dffeb80768e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:03.186545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.199185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1cd4-35e2-474f-a3e0-b313570094a4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.275177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.275809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.276096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.276375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.277137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.278776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c8e12-b58e-4a46-b0d7-ba534c4f2038 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.295991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1030/2066] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:03 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:03.297601 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.309081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde57e-7ce4-403b-927e-d96d9488d85a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.315664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.316585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.316828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.317104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] PATH_INFO: `/v3/projects/b8ed994d22e3497383246678b6bab588/users/0ab495a93501475ebbb46dffeb80768e/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.319178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ed994d22e3497383246678b6bab588, user_id=0ab495a93501475ebbb46dffeb80768e, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.322680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.354125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1037/2067] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:03 2021] PUT /identity/v3/projects/b8ed994d22e3497383246678b6bab588/users/0ab495a93501475ebbb46dffeb80768e/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:03.365010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.365423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.365601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.407680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] MFA Rules not processed for user `0ab495a93501475ebbb46dffeb80768e`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:03.409292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:03.491102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1031/2068] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:03 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:03.497780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.500919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:03.587425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d0dbe-b86b-4e9d-bbd1-bcda9e9c1376 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.591533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.592364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.592818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.593097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.604000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.605600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.616666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1038/2069] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:03 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:43:03.671537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:03.674118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:03.687207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97292-df30-473b-b4dc-e7a6b6e1b521 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:03.691298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:03.692062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:03.692434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:03.692782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:03.757393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:03.758928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f9953-07dd-436b-b9cb-24f5f4f9061b service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:03.769681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1032/2070] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:03 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:43:07.450843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:07.547709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b61a5-b7b9-4af6-8525-5b739d7d0106 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:07.553412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:07.554347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:07.554669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:07.554947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] PATH_INFO: `/v3/users/4b6bd2bec83948f4934bade48d121607` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:07.556266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6bd2bec83948f4934bade48d121607)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:07.558401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:07.633516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6bd2bec83948f4934bade48d121607'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:07.634328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6bd2bec83948f4934bade48d121607'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:07.635102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6bd2bec83948f4934bade48d121607'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:07.649889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6bd2bec83948f4934bade48d121607'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:07.660025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6bd2bec83948f4934bade48d121607'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:07.675149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1039/2071] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:07 2021] DELETE /identity/v3/users/4b6bd2bec83948f4934bade48d121607 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:07.679981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:07.680573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:07.680573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:07.705114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:07.706479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:07.807081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:07.807869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1033/2072] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:07.808936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:07.880613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29985e-883e-471b-87de-de32c619ebbd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:07.885188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:07.885944 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:07.886315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:07.886878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:07.904947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:07.908721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:07.929515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1040/2073] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:43:08.349044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:08.351119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:08.365572 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e271f-bf66-4461-a31e-e1b7fab4d643 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:08.370686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:08.371561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:08.371840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:08.372499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] PATH_INFO: `/v3/projects/9c867bee79c64a2b91892a479cb7deb1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:08.374548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c867bee79c64a2b91892a479cb7deb1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:08.376728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:08.454282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c867bee79c64a2b91892a479cb7deb1', 'request_id': 'req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.463719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c867bee79c64a2b91892a479cb7deb1', 'request_id': 'req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.473991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c867bee79c64a2b91892a479cb7deb1', 'request_id': 'req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.492730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] The token cache is being invalidate because project 9c867bee79c64a2b91892a479cb7deb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:08.493425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.494173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.496030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1034/2074] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:08 2021] DELETE /identity/v3/projects/9c867bee79c64a2b91892a479cb7deb1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:43:08.500759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:08.510998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dda586-3051-4894-9b28-35cf841d61f7 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:08.586308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:08.588442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:08.589097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:08.589736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] PATH_INFO: `/v3/users/0ab495a93501475ebbb46dffeb80768e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:08.593003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab495a93501475ebbb46dffeb80768e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:08.596395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:08.684811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab495a93501475ebbb46dffeb80768e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.685843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab495a93501475ebbb46dffeb80768e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.687013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab495a93501475ebbb46dffeb80768e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.706666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab495a93501475ebbb46dffeb80768e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.716763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-22965213-256c-496b-8f4c-b6578cfa7be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab495a93501475ebbb46dffeb80768e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:08.762982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1041/2075] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:08 2021] DELETE /identity/v3/users/0ab495a93501475ebbb46dffeb80768e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:09.194685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:09.197190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:09.220647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91df20-fae5-41a5-acbe-cd0bb2fc8658 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:09.333376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:09.333899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.334189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.334528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] PATH_INFO: `/v3/projects/b8ed994d22e3497383246678b6bab588` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.340718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ed994d22e3497383246678b6bab588)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:09.342807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:09.472765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ed994d22e3497383246678b6bab588', 'request_id': 'req-c4a002e5-6c41-4e6e-8565-9293d4922244'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:09.482120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ed994d22e3497383246678b6bab588', 'request_id': 'req-c4a002e5-6c41-4e6e-8565-9293d4922244'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:09.490192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ed994d22e3497383246678b6bab588', 'request_id': 'req-c4a002e5-6c41-4e6e-8565-9293d4922244'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:09.503514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] The token cache is being invalidate because project b8ed994d22e3497383246678b6bab588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:09.503808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:09.504469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c4a002e5-6c41-4e6e-8565-9293d4922244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:09.506086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1035/2076] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:09 2021] DELETE /identity/v3/projects/b8ed994d22e3497383246678b6bab588 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:09.512035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.512595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.512849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.538095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:09.539445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:09.655742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1042/2077] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:09.664714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.665025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.665307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.694644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:09.695909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:09.705032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1036/2078] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:09.708894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:09.720701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797fd62-c0d7-4593-9e03-5757f45c98cc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:09.726209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:09.727133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.727726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.728159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.729222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:43:09.729697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:09.731500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:09.749293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1043/2079] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:43:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:43:09.753231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:09.763761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c4d3a-50bb-4ea2-b941-9306de886958 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:09.769760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:09.770750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.771218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.771690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.772596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:09.775052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:09.809855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1037/2080] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:43:09 2021] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:09.811737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:09.828659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf5eee-af30-45da-9988-38cb9b20d06d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:09.955137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:09.956244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:09.956702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:09.957131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:09.958182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:09.960978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:09.991190 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1044/2081] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:43:09 2021] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:09.994579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:10.006622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d31e-0274-4f55-b496-7f5c58300332 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:10.014747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:10.015461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:10.015747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:10.016020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:10.016782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:10.018401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:10.032853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1038/2082] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:09 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:10.037416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:10.050867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b802f-c43d-4bf5-9288-81407b9b32fd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:10.060562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:10.061439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:10.061729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:10.062168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:10.062997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:10.064798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32337f1-6713-429d-82a8-a4f4491a7ad4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:10.077478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1045/2083] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:10.081899 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:10.098923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c434b5-e872-4ceb-ac98-0b298a74031c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:10.104105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:10.105003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:10.105377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:10.105655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] PATH_INFO: `/v3/projects/0314325d44b649b3a3498f0e2645a0a2/users/990592eb0d4c4bb692228399943c6a1b/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:10.121476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0314325d44b649b3a3498f0e2645a0a2, user_id=990592eb0d4c4bb692228399943c6a1b, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:10.124240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:10.141795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1039/2084] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:10 2021] PUT /identity/v3/projects/0314325d44b649b3a3498f0e2645a0a2/users/990592eb0d4c4bb692228399943c6a1b/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:10.153596 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fac7a-72e5-4cff-be2b-9435dbfd083b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:10.153833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fac7a-72e5-4cff-be2b-9435dbfd083b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:10.154705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fac7a-72e5-4cff-be2b-9435dbfd083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:10.184784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f14fac7a-72e5-4cff-be2b-9435dbfd083b None None] MFA Rules not processed for user `990592eb0d4c4bb692228399943c6a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:10.186274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f14fac7a-72e5-4cff-be2b-9435dbfd083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:10.279703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1046/2085] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:10 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:10.290338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:10.292305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:10.376933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e55041-7971-4090-a966-523f2227c6e0 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:10.381835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:10.382456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:10.382793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:10.383075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:10.393543 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:10.395074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:10.405590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1040/2086] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:10 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:43:11.751567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:11.752044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:11.752176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:11.805341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:11.806566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:11.872547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1047/2087] 10.222.0.76 () {58 vars in 967 bytes} [Thu Oct 28 08:43:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:11.887087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:11.889170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:11.990166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ce157-dae3-465b-8cba-eac1d2aeef6c service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:11.995458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:11.996125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:11.996411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:11.996687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:12.006024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:12.007651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e8697-4124-4b45-ae1f-f7bb1d043599 service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:12.017176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1041/2088] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:43:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:43:13.473834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:13.536172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2e99-921a-4d76-866b-44c0c2510f68 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:13.540891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:13.541763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:13.542046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:13.542327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] PATH_INFO: `/v3/users/990592eb0d4c4bb692228399943c6a1b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:13.543610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990592eb0d4c4bb692228399943c6a1b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:13.545562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:13.596022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990592eb0d4c4bb692228399943c6a1b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:13.596984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990592eb0d4c4bb692228399943c6a1b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:13.597574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990592eb0d4c4bb692228399943c6a1b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:13.609933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990592eb0d4c4bb692228399943c6a1b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:13.617300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990592eb0d4c4bb692228399943c6a1b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:13.630063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1048/2089] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:13 2021] DELETE /identity/v3/users/990592eb0d4c4bb692228399943c6a1b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:13.634555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167137-7487-4590-862b-364ca4227baa None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:13.635042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167137-7487-4590-862b-364ca4227baa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:13.635149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167137-7487-4590-862b-364ca4227baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:13.653525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f0167137-7487-4590-862b-364ca4227baa None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:13.654903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f0167137-7487-4590-862b-364ca4227baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:13.723142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1042/2090] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:13.734338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:13.735877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:13.809618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90aa2d4-8ede-4866-8bba-e3613e141307 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:13.814200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:13.814998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:13.815330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:13.815660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:13.827373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:13.829037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:13.839659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1049/2091] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:43:14.223874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167137-7487-4590-862b-364ca4227baa None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.225997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f0167137-7487-4590-862b-364ca4227baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.288501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.290255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.295436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167137-7487-4590-862b-364ca4227baa None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.300602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.301761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.306693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.307214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] PATH_INFO: `/v3/projects/0314325d44b649b3a3498f0e2645a0a2` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.309741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0314325d44b649b3a3498f0e2645a0a2)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.315163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5062a2-d944-41b6-8b70-0a4cbb2fdffd service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.323752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.328511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.329409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.329693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.329968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] PATH_INFO: `/v3/users/5df79cdd584947ff967966692375c45c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.332180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df79cdd584947ff967966692375c45c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.334087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.386909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0314325d44b649b3a3498f0e2645a0a2', 'request_id': 'req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.390521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df79cdd584947ff967966692375c45c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.391185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df79cdd584947ff967966692375c45c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.391885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df79cdd584947ff967966692375c45c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.395054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0314325d44b649b3a3498f0e2645a0a2', 'request_id': 'req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.401254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0314325d44b649b3a3498f0e2645a0a2', 'request_id': 'req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.405835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df79cdd584947ff967966692375c45c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.412458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b8bf9b5c-173c-4a1b-bd4b-e3b4a3dedc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df79cdd584947ff967966692375c45c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.415584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] The token cache is being invalidate because project 0314325d44b649b3a3498f0e2645a0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:14.415926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.416684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b9d73a7c-276b-4505-a6ce-4941d8ccf9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.418477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1043/2092] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:14 2021] DELETE /identity/v3/projects/0314325d44b649b3a3498f0e2645a0a2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:14.425227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.425514 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.425877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.426489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1050/2093] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:14 2021] DELETE /identity/v3/users/5df79cdd584947ff967966692375c45c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:14.444816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:14.446120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.506021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1044/2094] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:14.514164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.514852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.514852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.534941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:14.536172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.544228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1051/2095] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:14.548893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.558403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9553-6a78-4441-9757-1fa67cfa3b1a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.563651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.564245 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.564527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.564803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.565542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:43:14.565847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.567484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.581211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1045/2096] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:43:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:43:14.585078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.596046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d255f-202a-4617-b0e8-bfac33fda06f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.601752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.602622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.602914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.603185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.603652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.603917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.605503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.605970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.620073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b285296-f50c-44af-b4ce-95593d4f0c33 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.626542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.626969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.627242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.627517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] PATH_INFO: `/v3/projects/273c545d66f0479bb21eb8012fb29558` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.628914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273c545d66f0479bb21eb8012fb29558)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.630905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.637805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1052/2097] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:43:14 2021] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:14.639492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.682307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273c545d66f0479bb21eb8012fb29558', 'request_id': 'req-c061b52b-3690-49f6-88f5-5639e9ab9810'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.689845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273c545d66f0479bb21eb8012fb29558', 'request_id': 'req-c061b52b-3690-49f6-88f5-5639e9ab9810'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.696491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273c545d66f0479bb21eb8012fb29558', 'request_id': 'req-c061b52b-3690-49f6-88f5-5639e9ab9810'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.712067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] The token cache is being invalidate because project 273c545d66f0479bb21eb8012fb29558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:14.712403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.713142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:14.714885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1046/2098] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:14 2021] DELETE /identity/v3/projects/273c545d66f0479bb21eb8012fb29558 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:43:14.837754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a0b22-0b8b-4822-be12-5a4526049b16 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.903766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.905084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.905369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.905644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.906349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.908304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.929071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1053/2099] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:43:14 2021] POST /identity/v3/users => generated 284 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:14.933007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.934457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:14.948977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061b52b-3690-49f6-88f5-5639e9ab9810 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.955390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.956068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.956354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.956628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.957368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.959053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:14.970282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1047/2100] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:14 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:14.974593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:14.984965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81ee4a-fbc3-4118-b1c5-8c554c388d86 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:14.989517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:14.990164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:14.990447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:14.990757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:14.991520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:14.993143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10001e7e-d534-434c-a8fa-373317eb0512 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:15.006125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1054/2101] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:15.007404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:15.018076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab6a1e-9a62-4994-9c25-31ec4f92845b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:15.023054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:15.023936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:15.024241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:15.024513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] PATH_INFO: `/v3/projects/6589b86360794fb3a0d39f65ceec71b3/users/cb220123a7b043639a4bb3f477e61425/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:15.039850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6589b86360794fb3a0d39f65ceec71b3, user_id=cb220123a7b043639a4bb3f477e61425, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:15.042662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:15.056863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1048/2102] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:15 2021] PUT /identity/v3/projects/6589b86360794fb3a0d39f65ceec71b3/users/cb220123a7b043639a4bb3f477e61425/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:15.067392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:15.067691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:15.067970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:15.097185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] MFA Rules not processed for user `cb220123a7b043639a4bb3f477e61425`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:15.098251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:15.167505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1055/2103] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:15 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:15.179994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:15.181679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:15.257977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774142-c089-49b2-b99d-27192342c538 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:15.261732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:15.262380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:15.262694 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:15.262974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:15.271495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:15.272939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:15.281929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1049/2104] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:15 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:43:54.256479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:54.258902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:54.333109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840e543-2667-4c6a-8133-4547924b0dc0 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:54.339048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:54.339048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.339048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.339357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] PATH_INFO: `/v3/users/e0a3f84e4d9b4c77aab465f1e4df493d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.340660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a3f84e4d9b4c77aab465f1e4df493d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:54.342923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:54.390617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a3f84e4d9b4c77aab465f1e4df493d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.391424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a3f84e4d9b4c77aab465f1e4df493d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.392038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a3f84e4d9b4c77aab465f1e4df493d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.403221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a3f84e4d9b4c77aab465f1e4df493d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.410801 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-6b1978d9-0d76-4253-9915-2e8e7b0a5a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a3f84e4d9b4c77aab465f1e4df493d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.423649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1056/2105] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:43:54 2021] DELETE /identity/v3/users/e0a3f84e4d9b4c77aab465f1e4df493d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:54.596300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:54.610261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e372a3-07f8-401a-b287-d1db638a5b01 service glance] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:54.671974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:54.673053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.673339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.673618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] PATH_INFO: `/v3/projects/3831003e70cf4a62afb1393fbea6654e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.674907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3831003e70cf4a62afb1393fbea6654e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:54.676807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:54.727122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3831003e70cf4a62afb1393fbea6654e', 'request_id': 'req-9699d349-e2bf-446a-b8a6-c7313d23468a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.733625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3831003e70cf4a62afb1393fbea6654e', 'request_id': 'req-9699d349-e2bf-446a-b8a6-c7313d23468a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.739756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3831003e70cf4a62afb1393fbea6654e', 'request_id': 'req-9699d349-e2bf-446a-b8a6-c7313d23468a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.751768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] The token cache is being invalidate because project 3831003e70cf4a62afb1393fbea6654e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:43:54.752060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.752687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9699d349-e2bf-446a-b8a6-c7313d23468a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:43:54.754218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1050/2106] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:43:54 2021] DELETE /identity/v3/projects/3831003e70cf4a62afb1393fbea6654e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:54.759932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.760301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.760650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.780057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:54.782016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:54.838029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1057/2107] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:43:54.847462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.847752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.848033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.867571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:54.868754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:54.878272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1051/2108] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:54.882455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:54.899733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b469c-3d10-4dc0-98e1-85b1eadbbd90 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:54.904969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:54.905660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.906524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.906958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.907577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:43:54.907883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:54.909513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:54.921252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1058/2109] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:43:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:43:54.926303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:54.936315 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b898f-60a0-443c-9daf-c9b251a6cf56 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:54.941187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:54.941846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:54.942132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:54.942414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:54.943156 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:54.945285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:54.974540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1052/2110] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:43:54 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:54.977184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:54.987931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca8cd-5148-4bf4-bb0f-5842cd62817f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:55.051500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:55.052172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.052462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.052743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.053452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:55.055425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:55.078198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1059/2111] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:43:54 2021] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:43:55.082405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:55.091775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8a95a-ff41-4f02-9d4c-077836a6fdf1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:55.098591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:55.099444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.099830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.100205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.101259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:55.102988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:55.116299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1053/2112] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:43:55.120166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:55.130703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e59a-ab4e-4514-9cd9-44829a48c70e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:55.135753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:55.136370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.136658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.136944 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.137692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:55.139376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb355-17ec-4fea-86a7-a3b3d7e75030 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:55.151433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1060/2113] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:43:55.155746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:55.167661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f60e0-37de-46be-b2e4-36c7ddabac34 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:55.173018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:55.173925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.174208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.174481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] PATH_INFO: `/v3/projects/92830bd0e58a4eacac415bf468b5f64f/users/c3c1c2c543b54d02b57b26a3d96f586c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.189013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92830bd0e58a4eacac415bf468b5f64f, user_id=c3c1c2c543b54d02b57b26a3d96f586c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:55.191684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:55.204669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1054/2114] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:43:55 2021] PUT /identity/v3/projects/92830bd0e58a4eacac415bf468b5f64f/users/c3c1c2c543b54d02b57b26a3d96f586c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:43:55.214535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.214835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.215118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.242116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] MFA Rules not processed for user `c3c1c2c543b54d02b57b26a3d96f586c`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:43:55.243369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:55.307135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1061/2115] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:43:55 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:43:55.318116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:43:55.319930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:43:55.375801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da7fe3-6b4a-4936-ad83-290a67a08ef8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:43:55.379481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:43:55.380126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:43:55.380409 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:43:55.380684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:43:55.388929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:43:55.391049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e475d-26e4-444e-952f-1cabdbb0b015 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:43:55.399661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1055/2116] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:43:55 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:09.979846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.040316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a665f77-4845-486d-96a7-30dde3ab8f1e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.044797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.045653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.045935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.046219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] PATH_INFO: `/v3/users/c3c1c2c543b54d02b57b26a3d96f586c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.048256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c1c2c543b54d02b57b26a3d96f586c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.050255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.113758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c1c2c543b54d02b57b26a3d96f586c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.114418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c1c2c543b54d02b57b26a3d96f586c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.115068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c1c2c543b54d02b57b26a3d96f586c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.126949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c1c2c543b54d02b57b26a3d96f586c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.134355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c1c2c543b54d02b57b26a3d96f586c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.147592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1062/2117] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:09 2021] DELETE /identity/v3/users/c3c1c2c543b54d02b57b26a3d96f586c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:10.152340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.152790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.152790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.170508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:10.172370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.228716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1056/2118] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:10.239953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.241430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.298077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c099b6-3d90-4b60-9779-02f2e1a0b16d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.302475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.303159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.303450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.303728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.313441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.314955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.324510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1063/2119] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:10.587969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.589649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.602749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51deb2a-335d-470e-8c3f-2541e9612258 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.607599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.608480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.608760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.609120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] PATH_INFO: `/v3/projects/92830bd0e58a4eacac415bf468b5f64f` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.610517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92830bd0e58a4eacac415bf468b5f64f)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.612438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.645385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.646843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.661532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff918d4-29f7-47eb-b000-d1e3a47204ac service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.675139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92830bd0e58a4eacac415bf468b5f64f', 'request_id': 'req-7e8bd9f3-703f-43ff-ad57-21cec144c627'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.681878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92830bd0e58a4eacac415bf468b5f64f', 'request_id': 'req-7e8bd9f3-703f-43ff-ad57-21cec144c627'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.689724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92830bd0e58a4eacac415bf468b5f64f', 'request_id': 'req-7e8bd9f3-703f-43ff-ad57-21cec144c627'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.711991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] The token cache is being invalidate because project 92830bd0e58a4eacac415bf468b5f64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:10.711991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.711991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-7e8bd9f3-703f-43ff-ad57-21cec144c627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.712699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1057/2120] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:10 2021] DELETE /identity/v3/projects/92830bd0e58a4eacac415bf468b5f64f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:10.721050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fb0d-b0b2-4cb4-9cf9-67bb99260922 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.721362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fb0d-b0b2-4cb4-9cf9-67bb99260922 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.721612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18fb0d-b0b2-4cb4-9cf9-67bb99260922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.741165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.741969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.742265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.742574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] PATH_INFO: `/v3/users/cb220123a7b043639a4bb3f477e61425` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.742802 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9d18fb0d-b0b2-4cb4-9cf9-67bb99260922 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:10.743817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb220123a7b043639a4bb3f477e61425)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.744803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9d18fb0d-b0b2-4cb4-9cf9-67bb99260922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.745809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.761495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1058/2121] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:10.763609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.763609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.763816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.785041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:10.786351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.794837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1059/2122] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:10.795820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb220123a7b043639a4bb3f477e61425'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.796700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb220123a7b043639a4bb3f477e61425'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.797598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb220123a7b043639a4bb3f477e61425'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.798986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.808714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694ee98-ff0d-4744-ac15-2d1132128507 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.809933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb220123a7b043639a4bb3f477e61425'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.813803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.814470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.815029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.815266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.816141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:10.816470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.818273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.819554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8ad54110-2b4c-49bd-a9f3-3ad6b73ed6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb220123a7b043639a4bb3f477e61425'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:10.831207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1060/2123] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:44:10.835491 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.835743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1064/2124] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:10 2021] DELETE /identity/v3/users/cb220123a7b043639a4bb3f477e61425 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:10.837917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.840100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.840466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.840751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.852596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b7b5-649a-4a9b-8059-2b0d58465afd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:10.861643 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:10.862916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.915847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:10.916471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:10.916922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:10.917203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:10.917913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:10.919882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:10.928688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1065/2125] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:10.939925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:10.942114 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:10.948201 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1061/2126] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:10.953068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.010274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ee9aa-2546-4e3f-b967-922fe7b677fb None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.036174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac04b12-2862-42df-9dda-0e05401de3a3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.041124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.041838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.042124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.042402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.043648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.045059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.063463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.064594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.064920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.065257 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.068609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1062/2127] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:10 2021] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:11.072417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.087900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0de9-46df-4099-996b-9caa819473e5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.089091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.092334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.098866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.099573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.099861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.100144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.100902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.102559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.104378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1066/2128] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:11.119583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1063/2129] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:11 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:11.120686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.132014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff63533-ea3a-4558-8ead-bb47e6485c00 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.136823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.137488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.137912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.138050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.138823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.141487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8789811-2b76-49e8-8890-50ba6cb94f76 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.154558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1067/2130] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:11 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:11.158583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.174488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcbc42-9708-4e8f-ae2c-2aca05161d1f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.181461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.183153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.183443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.183728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] PATH_INFO: `/v3/projects/6b65bf6c9a854d08ad9a2f609ff08057/users/e44adce09ee14814a1c876dbf2284b5a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.204344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b65bf6c9a854d08ad9a2f609ff08057, user_id=e44adce09ee14814a1c876dbf2284b5a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.207652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.242441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1064/2131] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:11 2021] PUT /identity/v3/projects/6b65bf6c9a854d08ad9a2f609ff08057/users/e44adce09ee14814a1c876dbf2284b5a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:11.243814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.244295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.244757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.284452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] MFA Rules not processed for user `e44adce09ee14814a1c876dbf2284b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:11.286026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.371025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1068/2132] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:11.374126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.425497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.427962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.449645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6f41c-d895-4d55-a22d-db9ec7ce5602 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.456816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.457545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.457884 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.458170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.459059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.461923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.500162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1065/2133] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:11.501466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.526727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037d60e-6a8e-48df-88e6-ab9a78d18c17 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.572452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a33a01-76c8-4c63-9966-01a9d515d968 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.577394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.578356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.578356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.578805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.579462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.581376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.585940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.586835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.587126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.587406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] PATH_INFO: `/v3/projects/6589b86360794fb3a0d39f65ceec71b3` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.588921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6589b86360794fb3a0d39f65ceec71b3)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.590962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.606580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1066/2134] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:11.611304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.624301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e396d-405a-4b20-845f-de0d8f73c0b9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.630661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.631339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.631677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.631954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.632733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.634330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.644378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6589b86360794fb3a0d39f65ceec71b3', 'request_id': 'req-77a390b3-d462-42ba-92bc-352b5b4967c7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:11.644936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1067/2135] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:11 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:11.648787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.652819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6589b86360794fb3a0d39f65ceec71b3', 'request_id': 'req-77a390b3-d462-42ba-92bc-352b5b4967c7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:11.660249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce631d-6676-4617-b420-fd571c5254d4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.660725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6589b86360794fb3a0d39f65ceec71b3', 'request_id': 'req-77a390b3-d462-42ba-92bc-352b5b4967c7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:11.676068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] The token cache is being invalidate because project 6589b86360794fb3a0d39f65ceec71b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:11.676420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:11.677083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-77a390b3-d462-42ba-92bc-352b5b4967c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:11.681721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1069/2136] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:11 2021] DELETE /identity/v3/projects/6589b86360794fb3a0d39f65ceec71b3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:11.688030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b04f-b117-4d08-9b05-6fcbd7fcef68 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.688460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b04f-b117-4d08-9b05-6fcbd7fcef68 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.688745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b04f-b117-4d08-9b05-6fcbd7fcef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.709039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-fbd4b04f-b117-4d08-9b05-6fcbd7fcef68 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:11.710271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fbd4b04f-b117-4d08-9b05-6fcbd7fcef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.730892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.731889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.732246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.732628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] PATH_INFO: `/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6/users/0aa1236699df4a74a1309ee1bf4385b4/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.749371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dda8168c05d4f5cb706f8ccfb9a51e6, user_id=0aa1236699df4a74a1309ee1bf4385b4, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.752357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.770534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1068/2137] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:11 2021] PUT /identity/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6/users/0aa1236699df4a74a1309ee1bf4385b4/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:11.773829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.775678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.778546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1070/2138] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:11.785482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.785699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.785979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.804723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:11.805986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.850565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff500bd-72e2-4714-b4cc-7176b96c8fa1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.855599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.856537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.856904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.857300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.858126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.861039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.871618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1071/2139] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:11.874560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1069/2140] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:11 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:44:11.876623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.877461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.886231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd31fb-d6fd-47d2-b50b-2725457289d1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.888612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58df897-4d70-431b-b82f-ee15f8d28433 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.892594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.894365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.894365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.894365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.894701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:11.894938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.896307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:11.896527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.897333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.897689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.898045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] PATH_INFO: `/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6/users/0aa1236699df4a74a1309ee1bf4385b4/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.900607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dda8168c05d4f5cb706f8ccfb9a51e6, user_id=0aa1236699df4a74a1309ee1bf4385b4, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:11.903609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9b264-9fae-4c63-bd9e-2eb5c4fd403e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:11.912721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1072/2141] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:44:11.918256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1070/2142] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:11 2021] PUT /identity/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6/users/0aa1236699df4a74a1309ee1bf4385b4/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:11.928267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:11.930482 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:11.930806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:11.931085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:11.932252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a3c94-2285-4437-8343-19c649a4fec1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:11.961291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] MFA Rules not processed for user `0aa1236699df4a74a1309ee1bf4385b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:11.962603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:11.999251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.000567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.000855 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.001137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.001893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.004002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.041096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1073/2143] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:12.044669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.059056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1071/2144] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:11 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:12.069415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.070900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:12.124657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85569dea-fcc6-4ce9-961b-b6e8676bf76b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.129679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.130429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.130837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.131133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.131848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.133763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.144706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237733e-8cc5-4622-b841-0a6870b80492 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.155181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1074/2145] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:12 2021] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:12.159983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.170332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c67059-f9d1-4b89-91c2-34eda877f550 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.175780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.176548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.177028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.177857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.178243 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.179969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.191720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1075/2146] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:12.195574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.207328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62f45-854b-41eb-ac3d-8b928646b2c9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.208954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.208954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.208954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.209591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.213513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.214260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.214644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.215014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.215835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.217585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.230575 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1076/2147] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:44:12.232661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.245995 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff27b1-6812-444f-b262-c046258352f6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.251739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.252702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.253085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.253380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] PATH_INFO: `/v3/projects/6f5721bb891e4132873004e31ec44110/users/d4c2dfc90eee46afb53bb6ae1a2e53ac/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.269824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5721bb891e4132873004e31ec44110, user_id=d4c2dfc90eee46afb53bb6ae1a2e53ac, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.272535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e492a5-8b0b-46a2-89f8-13b89df1eaf5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.274957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.276419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.288533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1077/2148] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:12 2021] PUT /identity/v3/projects/6f5721bb891e4132873004e31ec44110/users/d4c2dfc90eee46afb53bb6ae1a2e53ac/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:12.290824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1072/2149] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:12 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:12.303164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.303459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.303941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.376076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] MFA Rules not processed for user `d4c2dfc90eee46afb53bb6ae1a2e53ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:12.377352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:12.424990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.433921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46a13d-366f-4715-800d-0fad4b1e9a01 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.480964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1078/2150] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:12.487837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:12.489631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:12.495902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.496669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.497028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.497375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.500084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:12.570895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.571688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040222d-660c-48f7-909c-e5bf825db5cc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:12.572688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.575921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:12.576665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:12.577022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:12.577606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:12.590520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:12.592162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:12.596323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1073/2151] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:12 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:12.603172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1079/2152] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:12 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:14.074149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:14.075685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:14.151488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397807f-f7e2-43ba-bb25-9c2cb7d629c8 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:14.156957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:14.157856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.158136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.158405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] PATH_INFO: `/v3/users/aaeb0fe842e54e3b9f0750069d83231c` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.159708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaeb0fe842e54e3b9f0750069d83231c)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:14.161672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:14.226727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaeb0fe842e54e3b9f0750069d83231c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.227505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaeb0fe842e54e3b9f0750069d83231c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.235692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaeb0fe842e54e3b9f0750069d83231c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.247865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaeb0fe842e54e3b9f0750069d83231c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.255663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3181a940-97b3-49ed-abe2-513db4217347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaeb0fe842e54e3b9f0750069d83231c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.266541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1074/2153] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:14 2021] DELETE /identity/v3/users/aaeb0fe842e54e3b9f0750069d83231c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:14.652759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:14.666403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1dd77-cd22-4248-960e-38ed22e4ae96 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:14.723755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:14.724609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.724890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.725163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] PATH_INFO: `/v3/projects/241b556f8519472bb4fbe40400334a65` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.726361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=241b556f8519472bb4fbe40400334a65)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:14.728298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:14.773261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241b556f8519472bb4fbe40400334a65', 'request_id': 'req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.778764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241b556f8519472bb4fbe40400334a65', 'request_id': 'req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.784815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241b556f8519472bb4fbe40400334a65', 'request_id': 'req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.797934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] The token cache is being invalidate because project 241b556f8519472bb4fbe40400334a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:14.798294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.799206 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-938c4005-5c2a-4ab4-a5f3-02a93711ddfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:14.801201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1080/2154] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:14 2021] DELETE /identity/v3/projects/241b556f8519472bb4fbe40400334a65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:14.807510 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.807824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.808155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.830891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:14.832123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:14.896375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1075/2155] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:14.905193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.905550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.905781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.927833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:14.929095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:14.940058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1081/2156] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:14.944712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:14.955370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe94d-c20b-4f17-bfff-54df8664ee0a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:14.960014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:14.960711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.960990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.961261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.962001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:14.962307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:14.964094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:14.980864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1076/2157] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:14.982387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:14.992474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a43993-3a58-438a-aedb-e1e1d4394892 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:14.997187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:14.997862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:14.998106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:14.998383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:14.999130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.001792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.028829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1082/2158] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:14 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:15.033105 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.043322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e7c52-0dc3-45c2-87c1-712aab158289 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.113722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.114404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.114829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.115016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.115696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.117655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.143340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1077/2159] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:15 2021] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:15.147370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.158719 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd719-f326-4a99-86cf-5ad258f6ea72 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.163927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.164628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.164914 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.165192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.165942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.167587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.183291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.190087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1083/2160] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:15 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:15.193805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551df656-cdd8-4472-aab1-5e042fccd9c9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.198683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.199357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.199716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.199903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.200703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.202236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.213049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1078/2161] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:15.217350 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.228759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb38fdb-5985-4a06-aa6f-5a551143a357 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.233334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.234907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.235157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.235441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] PATH_INFO: `/v3/projects/5fff4d41b05c4901a15ac9699551c1e4/users/2c6f4af30b1643a48fe8e5f9ff025b79/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.249370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fff4d41b05c4901a15ac9699551c1e4, user_id=2c6f4af30b1643a48fe8e5f9ff025b79, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.252053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e14c-40d8-4a36-b2ef-019cb1bd309f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.269153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1084/2162] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:15 2021] PUT /identity/v3/projects/5fff4d41b05c4901a15ac9699551c1e4/users/2c6f4af30b1643a48fe8e5f9ff025b79/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:15.279547 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.280375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.281372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.281683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.283227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.295854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2586e-8383-4f57-b4b0-66c8f2270f80 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.311735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] MFA Rules not processed for user `2c6f4af30b1643a48fe8e5f9ff025b79`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:15.313229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.364427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.365301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.365581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.365852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] PATH_INFO: `/v3/users/e44adce09ee14814a1c876dbf2284b5a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.367102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44adce09ee14814a1c876dbf2284b5a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.369008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.380885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1085/2163] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:15.394185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.396161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.417054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44adce09ee14814a1c876dbf2284b5a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.417722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44adce09ee14814a1c876dbf2284b5a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.425144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44adce09ee14814a1c876dbf2284b5a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.437294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44adce09ee14814a1c876dbf2284b5a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.446293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d48d0692-f287-470c-84b3-63c86be2b1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44adce09ee14814a1c876dbf2284b5a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.453940 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1079/2164] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:15 2021] DELETE /identity/v3/users/e44adce09ee14814a1c876dbf2284b5a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:15.458429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.458865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.459472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.476796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:15.478006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.495038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697daeb-a55a-4200-bb97-affb56a42272 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.536656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1080/2165] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:15.547738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.549043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.558650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.559312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.559595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.560268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.561710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.612622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ee060-bdee-4e74-8bde-675382f6308c None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.616654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.617338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.617685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.617905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.619967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.621595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.628463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.629929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.631611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1086/2166] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:15 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:15.646600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1081/2167] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:15.883414 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.884895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.898378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac504e5-f26b-4d59-a6cf-359a391f2893 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.903998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.905141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.906904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.907196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] PATH_INFO: `/v3/users/2c6f4af30b1643a48fe8e5f9ff025b79` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.908674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6f4af30b1643a48fe8e5f9ff025b79)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.910709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.930832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:15.932612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:15.955134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100687a-e6c9-4943-a6f1-16358a239932 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:15.962116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6f4af30b1643a48fe8e5f9ff025b79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.962787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6f4af30b1643a48fe8e5f9ff025b79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.963082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:15.963569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6f4af30b1643a48fe8e5f9ff025b79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.964141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:15.964492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:15.964846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] PATH_INFO: `/v3/projects/6b65bf6c9a854d08ad9a2f609ff08057` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:15.966158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b65bf6c9a854d08ad9a2f609ff08057)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:15.968782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:15.977032 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6f4af30b1643a48fe8e5f9ff025b79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.985148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2763d307-0875-4d07-bdc0-50ba30e5df41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6f4af30b1643a48fe8e5f9ff025b79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:15.998261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1087/2168] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:15 2021] DELETE /identity/v3/users/2c6f4af30b1643a48fe8e5f9ff025b79 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:16.003437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.003724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.004017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.017452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b65bf6c9a854d08ad9a2f609ff08057', 'request_id': 'req-e7ee92e6-a662-4163-aa34-6c3e8170453d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.020794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.022007 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.023503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b65bf6c9a854d08ad9a2f609ff08057', 'request_id': 'req-e7ee92e6-a662-4163-aa34-6c3e8170453d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.029229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b65bf6c9a854d08ad9a2f609ff08057', 'request_id': 'req-e7ee92e6-a662-4163-aa34-6c3e8170453d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.043511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] The token cache is being invalidate because project 6b65bf6c9a854d08ad9a2f609ff08057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:16.043808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.044432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.046092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1082/2169] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:15 2021] DELETE /identity/v3/projects/6b65bf6c9a854d08ad9a2f609ff08057 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:16.050607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.052184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.084261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1088/2170] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:16.099641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.101083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.120599 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee92e6-a662-4163-aa34-6c3e8170453d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.126256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.127188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.127473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.127748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] PATH_INFO: `/v3/users/0aa1236699df4a74a1309ee1bf4385b4` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.128973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa1236699df4a74a1309ee1bf4385b4)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.130948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.159286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7951ab8-f9a5-4c89-b282-91fb6c458840 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.163587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.164399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.164822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.165161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.175787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.177268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.179525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa1236699df4a74a1309ee1bf4385b4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.180197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa1236699df4a74a1309ee1bf4385b4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.187000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1089/2171] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:16.193301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa1236699df4a74a1309ee1bf4385b4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.213873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa1236699df4a74a1309ee1bf4385b4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.226974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9f8bd2ec-3712-463e-899d-4f9905f477e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa1236699df4a74a1309ee1bf4385b4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.227847 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.230334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.236435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1083/2172] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:16 2021] DELETE /identity/v3/users/0aa1236699df4a74a1309ee1bf4385b4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:16.254734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26803b-15f6-44f7-ab6c-181b0820dee0 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.341418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.342696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.344209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.345808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] PATH_INFO: `/v3/users/d4c2dfc90eee46afb53bb6ae1a2e53ac` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.347263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c2dfc90eee46afb53bb6ae1a2e53ac)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.350712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.411038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c2dfc90eee46afb53bb6ae1a2e53ac'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.411813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c2dfc90eee46afb53bb6ae1a2e53ac'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.412474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c2dfc90eee46afb53bb6ae1a2e53ac'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.431709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c2dfc90eee46afb53bb6ae1a2e53ac'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.444104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c2dfc90eee46afb53bb6ae1a2e53ac'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.458220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1090/2173] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:16 2021] DELETE /identity/v3/users/d4c2dfc90eee46afb53bb6ae1a2e53ac => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:16.463142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.463544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.463923 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.482439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.483854 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.542217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1084/2174] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:16.552491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.554019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.616948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.618591 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b6146-9b1d-4a92-9a99-bfc26f1d78ac admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.618731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.625002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.625749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.626103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.626829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.636860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef66c3-3cad-4c8e-94a1-76230ec03b7e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.637483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.639359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.648955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.650211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.650986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.651120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1091/2175] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:16.651208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] PATH_INFO: `/v3/projects/5fff4d41b05c4901a15ac9699551c1e4` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.651600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.652553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fff4d41b05c4901a15ac9699551c1e4)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.652906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.654972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.667532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3d7a5-d6fb-42a9-a041-a77efc096b6e service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.672873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.673784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.674081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.674358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] PATH_INFO: `/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.675624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dda8168c05d4f5cb706f8ccfb9a51e6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.677772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.716569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fff4d41b05c4901a15ac9699551c1e4', 'request_id': 'req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.725782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fff4d41b05c4901a15ac9699551c1e4', 'request_id': 'req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.733506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fff4d41b05c4901a15ac9699551c1e4', 'request_id': 'req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.742983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dda8168c05d4f5cb706f8ccfb9a51e6', 'request_id': 'req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.751902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dda8168c05d4f5cb706f8ccfb9a51e6', 'request_id': 'req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.753127 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] The token cache is being invalidate because project 5fff4d41b05c4901a15ac9699551c1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:16.753681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.754666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-39996f6f-36d0-45e1-b81c-2d1db7b6b1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.756659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1085/2176] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:16 2021] DELETE /identity/v3/projects/5fff4d41b05c4901a15ac9699551c1e4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:16.762344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36109-841a-461b-821a-4fae1ae029cf None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.764016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36109-841a-461b-821a-4fae1ae029cf None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.766228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36109-841a-461b-821a-4fae1ae029cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.771087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dda8168c05d4f5cb706f8ccfb9a51e6', 'request_id': 'req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.794235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] The token cache is being invalidate because project 1dda8168c05d4f5cb706f8ccfb9a51e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:16.794602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.795522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-9e232f7d-763e-49d7-a8ab-17a04d4e6fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:16.797931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1092/2177] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:16 2021] DELETE /identity/v3/projects/1dda8168c05d4f5cb706f8ccfb9a51e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:16.803005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3ef36109-841a-461b-821a-4fae1ae029cf None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.804246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ed4-21ba-4e2b-9642-239c5e886327 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.804379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3ef36109-841a-461b-821a-4fae1ae029cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.804565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ed4-21ba-4e2b-9642-239c5e886327 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.804858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ed4-21ba-4e2b-9642-239c5e886327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.829641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f98b3ed4-21ba-4e2b-9642-239c5e886327 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.831063 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f98b3ed4-21ba-4e2b-9642-239c5e886327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.900252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1086/2178] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:16.908640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.908930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.909212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.920749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1093/2179] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:16.929393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.930015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.930750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.931224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.931507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.941690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1087/2180] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:16.946122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.953251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:16.954978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:16.962508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3a76c-f25c-4590-9376-35f43d049350 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.963737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1094/2181] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:16.968468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:16.968994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.970628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.970914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.971188 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.971952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:16.972255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.976992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.980994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed963-6d96-4381-9dc7-953aa7cb861e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:16.986552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:16.987224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:16.987509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:16.987793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:16.988523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:16.988829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:16.990614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:16.994912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1088/2182] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:44:16.995776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.007145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd794e-f35d-43bd-813c-2a353e81a306 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.012929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1095/2183] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:44:17.012929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.017455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.018162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.018591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.019905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.020844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.022853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.024623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66d85-557e-4ded-95bd-fc334e66ecd7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.030827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.031676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.031765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.032455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.032932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.035044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.054546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1089/2184] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:16 2021] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:17.054546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.055211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.070477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1096/2185] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.070477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.126658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac07e6-71aa-4c69-ab6f-4fbfc4af8188 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.131324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.132221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.132529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.132806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] PATH_INFO: `/v3/projects/6f5721bb891e4132873004e31ec44110` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.134035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5721bb891e4132873004e31ec44110)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.135577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f34597-a17b-4a6e-b1b3-38834380ea52 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.136011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.140521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.141183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.141477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.141754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.142603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.144528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.164418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1097/2186] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.165271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.175990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a93d-a940-4409-8e94-c4bf95e63ff5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.185549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5721bb891e4132873004e31ec44110', 'request_id': 'req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:17.192501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5721bb891e4132873004e31ec44110', 'request_id': 'req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:17.197989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5721bb891e4132873004e31ec44110', 'request_id': 'req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:17.211863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] The token cache is being invalidate because project 6f5721bb891e4132873004e31ec44110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:17.212161 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:17.213041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:17.214893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1090/2187] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:17 2021] DELETE /identity/v3/projects/6f5721bb891e4132873004e31ec44110 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:17.215678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.217080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.235878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.236665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.236943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.237215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.237929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.239950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39392c-43d4-4e98-8c00-00bdb386f1d3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.262023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1098/2188] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.263536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.263839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.264123 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.284035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:17.284347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52131b-f4a4-4617-b0b0-57ba6ffa49f9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.285260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.289464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.290150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.290437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.290754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.291542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.293172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd48860-b22b-4ae9-ac89-e7101b17aac2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.293582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1099/2189] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:17.294617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.295966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.310082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b6fc-84e4-4c21-b120-0c4b3e102dd0 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.313507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1091/2190] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.315261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.315627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.315977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.319958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.320690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.320973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.321251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.322008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.323723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.334025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1100/2191] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.334733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.335771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:17.337090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.344962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e6671-4351-42b9-a2aa-1307e9d08dea admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.345144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1092/2192] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:17.346219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.351574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.352439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.352725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.353001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.353783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.355408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353095-68d8-47f1-8083-5340a5edae26 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.355537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.361078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.361730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.362010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.362286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.363479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.365071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.366527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1101/2193] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.370548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.376843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1093/2194] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.377618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.380897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d45df-46b4-4cdc-9d43-65274a8f108c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.385644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.386290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.386609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.386886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.387624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:17.387933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.388382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63053d-2fc7-467b-a8dc-fbeb1fbbd89f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.389600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.393232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.394124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.394406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.394707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] PATH_INFO: `/v3/projects/d18bfb2d18b442269417cd4a1ed0a220/users/783981dc3a4d47d2aa996527fe978773/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.401791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1102/2195] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:17.402627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.410314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18bfb2d18b442269417cd4a1ed0a220, user_id=783981dc3a4d47d2aa996527fe978773, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.413002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.415716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9254a1-ac09-47f6-9fe2-79a3b22476af admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.420796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.422482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.422827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.423184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] PATH_INFO: `/v3/projects/755843fce65347898570601ab03f8202/users/c7b47cfd3e8941b79ec23157f416b5d7/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.427209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1094/2196] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:17 2021] PUT /identity/v3/projects/d18bfb2d18b442269417cd4a1ed0a220/users/783981dc3a4d47d2aa996527fe978773/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:17.428178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.439155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755843fce65347898570601ab03f8202, user_id=c7b47cfd3e8941b79ec23157f416b5d7, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.441824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43a2de-1264-4671-8cab-d93a0a7cd066 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.455413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1103/2197] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:17 2021] PUT /identity/v3/projects/755843fce65347898570601ab03f8202/users/c7b47cfd3e8941b79ec23157f416b5d7/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:17.464483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd62fb3-dc6b-409d-9701-26d87d547565 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.464483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd62fb3-dc6b-409d-9701-26d87d547565 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.464483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd62fb3-dc6b-409d-9701-26d87d547565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.486815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6cd62fb3-dc6b-409d-9701-26d87d547565 None None] MFA Rules not processed for user `783981dc3a4d47d2aa996527fe978773`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:17.488047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6cd62fb3-dc6b-409d-9701-26d87d547565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.500709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09cb55-c3a9-446a-a6a5-cbeadb629c6a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.550742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1104/2198] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:17.554674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.554674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.554674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.554936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.555594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.555872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.557202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.557973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.559947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.579981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] MFA Rules not processed for user `c7b47cfd3e8941b79ec23157f416b5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:17.581212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:17.585513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1095/2199] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.586452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.650013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1105/2200] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:17.651276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.651779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707de66-de11-429a-be1e-c34a42d832d8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.657847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.658577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.658866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.659145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.659887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.661904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.662329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358329-5f58-4acb-a000-ce7e374a7d00 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.666963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.667656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.667901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.668204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.668901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.670821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.690690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1096/2201] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.691513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.695844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1106/2202] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.695844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.705997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63965b5-78ea-4494-bda9-38dd2b73591d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.754999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af33136-d48c-4110-bced-fd02741c0d1e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.759768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.760419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.760710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.760985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.761689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.763681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.767960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.768628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.768912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.769189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.769879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.771834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.791407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1097/2203] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:17.792066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1107/2204] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:17.792870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.795199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.805760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7a5dc-dbb2-475e-84e8-3e462f243aa5 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.854750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeafd64-4721-4c97-b1de-605e29ac6a46 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.860372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.861055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.861448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.861683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.862355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.862595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.863149 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.863466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.863750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.864405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.864533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.866606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.875763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1098/2205] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.876655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.888744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccb81c-dba1-4d32-a04d-74b69350822f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.890543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1108/2206] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:17 2021] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:17.891572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.897846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.898560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.898887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.899120 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.899878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.901489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.903537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc2d4f-19b6-4250-8235-b74a1ac23d0a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.909852 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.910617 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.910906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.911189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.912156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.913961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.916832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1099/2207] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.917748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.926677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1109/2208] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.927750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.929681 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce96e6-d18f-4e2c-b877-c94e24dcfd1b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.934573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.935253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.935541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.935815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.937627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.939674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.941139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2cf31-50fe-4ef7-adf0-96143b8e4d3e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.945900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.946813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.947094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.947372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] PATH_INFO: `/v3/projects/2a5013e14f194a8a877a64186c375841/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.951283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1100/2209] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:17.951919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.962900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2684f-e328-4c6a-82c4-ee96e75eb0b3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:17.964177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5013e14f194a8a877a64186c375841, user_id=8f4b5f31ef3d423a9ed423ce2ed5c1fe, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.966873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:17.968030 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:17.969476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:17.969759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:17.970033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] PATH_INFO: `/v3/projects/3b5a1400e6c8401a9ac7192333826fde/users/f262d208d53949b8a1836c8aa4fc3376/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:17.982371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1110/2210] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:17 2021] PUT /identity/v3/projects/2a5013e14f194a8a877a64186c375841/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:17.983209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:17.986769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5a1400e6c8401a9ac7192333826fde, user_id=f262d208d53949b8a1836c8aa4fc3376, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:17.989548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.003260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1101/2211] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:17 2021] PUT /identity/v3/projects/3b5a1400e6c8401a9ac7192333826fde/users/f262d208d53949b8a1836c8aa4fc3376/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:18.004145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.045529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dc12-948e-4b47-a80e-dccaa928c51e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.072641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874faa12-88b4-4fc8-b1eb-d6cfc272e20e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.079652 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.080625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.080934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.081197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.082013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.083867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c59d7-0cbf-4484-ad02-8258d8403ffe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.095762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1102/2212] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:18.097160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.097426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.097868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.105445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.106602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.106949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.107290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] PATH_INFO: `/v3/projects/f44cf27053ee41a08c6b9af77887b682/users/11e1828a994b4a1990e6401304743a5d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.117018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:18.118251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.123842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44cf27053ee41a08c6b9af77887b682, user_id=11e1828a994b4a1990e6401304743a5d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.126405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1103/2213] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:18.127236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.130699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.138232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7effd4-63a7-4752-b818-1b69c203af9a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.144607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.145407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.145693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.145972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] PATH_INFO: `/v3/projects/2a5013e14f194a8a877a64186c375841/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.146375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1111/2214] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:17 2021] PUT /identity/v3/projects/f44cf27053ee41a08c6b9af77887b682/users/11e1828a994b4a1990e6401304743a5d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:18.147401 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.149033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.151243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5013e14f194a8a877a64186c375841, user_id=8f4b5f31ef3d423a9ed423ce2ed5c1fe, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.153875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.165587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1104/2215] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:18 2021] PUT /identity/v3/projects/2a5013e14f194a8a877a64186c375841/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:18.176284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.208671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3530f0-bcfc-4190-8807-57497592cd61 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.231399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebdc2a-66b1-42b5-847f-63abf1120b9d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.236345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.237020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.237302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.237580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.238337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.239990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b43f7-974f-4ffd-9568-161eb5febafc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.253651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1105/2216] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:18 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:18.253651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.253651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.253651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.259487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.260146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.260422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.260698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.271913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.273364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.282088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] MFA Rules not processed for user `8f4b5f31ef3d423a9ed423ce2ed5c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:18.283360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.284062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1112/2217] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:18.284912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.294637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1529d-bda1-4390-b312-3ea9b7767bda service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.300467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.301731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.302298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.302693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] PATH_INFO: `/v3/projects/f44cf27053ee41a08c6b9af77887b682/users/11e1828a994b4a1990e6401304743a5d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.305108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44cf27053ee41a08c6b9af77887b682, user_id=11e1828a994b4a1990e6401304743a5d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.307936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1b86-7338-4a37-8698-a73827eff58c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.322524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1113/2218] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:18 2021] PUT /identity/v3/projects/f44cf27053ee41a08c6b9af77887b682/users/11e1828a994b4a1990e6401304743a5d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:18.335205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.335788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.336184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.367421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] MFA Rules not processed for user `11e1828a994b4a1990e6401304743a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:18.369581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.374981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1106/2219] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:18 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:18.386745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.388742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.451234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263496b1-0f79-4314-b5f6-e5ac7d100abe None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.455081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1114/2220] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:18 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:18.465579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:18.467245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:18.519850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.520509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.521028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.521028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.538706 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683653b-48dd-44ff-9694-5adb5327721b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:18.543525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:18.544308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:18.544635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:18.544866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:18.556247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.557960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.571988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1115/2221] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:18 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:18.615545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:18.617129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd3579-770e-43a1-a4d6-02b613d0dc82 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:18.635749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1107/2222] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:18 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:19.263225 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:19.338181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7826a-cda7-4c3e-bd88-f99b9d9ded60 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:19.343437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:19.344351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:19.344634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:19.344911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] PATH_INFO: `/v3/users/c7b47cfd3e8941b79ec23157f416b5d7` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:19.346435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b47cfd3e8941b79ec23157f416b5d7)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:19.348405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:19.416953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b47cfd3e8941b79ec23157f416b5d7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:19.417744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b47cfd3e8941b79ec23157f416b5d7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:19.418400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b47cfd3e8941b79ec23157f416b5d7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:19.434552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b47cfd3e8941b79ec23157f416b5d7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:19.446064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b47cfd3e8941b79ec23157f416b5d7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:19.472322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1116/2223] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:19 2021] DELETE /identity/v3/users/c7b47cfd3e8941b79ec23157f416b5d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:19.477898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:19.478898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:19.479664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:19.505004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:19.507305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:19.588248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1108/2224] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:19.600755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:19.603831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:19.701654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6ca35-7564-4762-bf00-2d5d81d87b1d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:19.707594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:19.709626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:19.710019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:19.710768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:19.723960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:19.725917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:19.742638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1117/2225] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:20.154331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:20.158092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:20.184216 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3409c9-1a25-4a53-b6e7-fb6858241d2a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:20.207321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:20.214775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:20.215391 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:20.216796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] PATH_INFO: `/v3/projects/755843fce65347898570601ab03f8202` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:20.223499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] RBAC: Authorizing `identity:delete_project(project_id=755843fce65347898570601ab03f8202)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:20.234452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:20.359831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755843fce65347898570601ab03f8202', 'request_id': 'req-ac897bf5-f507-463f-925d-3988e36c746f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.368335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755843fce65347898570601ab03f8202', 'request_id': 'req-ac897bf5-f507-463f-925d-3988e36c746f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.386642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755843fce65347898570601ab03f8202', 'request_id': 'req-ac897bf5-f507-463f-925d-3988e36c746f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.413222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] The token cache is being invalidate because project 755843fce65347898570601ab03f8202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:20.413887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.414779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.419774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1109/2226] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:20 2021] DELETE /identity/v3/projects/755843fce65347898570601ab03f8202 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:20.426091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:20.457743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a50e3b-85dc-4ef5-a147-4240aba22ebc service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:20.505409 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:20.506914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:20.543525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:20.544848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:20.545345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:20.545811 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] PATH_INFO: `/v3/users/11e1828a994b4a1990e6401304743a5d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:20.548283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e1828a994b4a1990e6401304743a5d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:20.550455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:20.585952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897bf5-f507-463f-925d-3988e36c746f admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:20.591426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:20.592303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:20.592610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:20.593458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] PATH_INFO: `/v3/users/783981dc3a4d47d2aa996527fe978773` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:20.594963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783981dc3a4d47d2aa996527fe978773)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:20.597160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:20.604373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e1828a994b4a1990e6401304743a5d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.605281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e1828a994b4a1990e6401304743a5d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.606537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e1828a994b4a1990e6401304743a5d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.622998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e1828a994b4a1990e6401304743a5d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.632508 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-e5af87c4-9c69-4206-921b-bcc46c6a0ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e1828a994b4a1990e6401304743a5d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.647917 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1118/2227] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:20 2021] DELETE /identity/v3/users/11e1828a994b4a1990e6401304743a5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:20.655101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783981dc3a4d47d2aa996527fe978773'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.657427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783981dc3a4d47d2aa996527fe978773'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.665717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783981dc3a4d47d2aa996527fe978773'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.682952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783981dc3a4d47d2aa996527fe978773'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.692791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783981dc3a4d47d2aa996527fe978773'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:20.705273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1110/2228] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:20 2021] DELETE /identity/v3/users/783981dc3a4d47d2aa996527fe978773 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:20.710211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:20.712519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:20.713139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:20.736853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:20.738251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:20.810444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1119/2229] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:20.831788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:20.833429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:20.937328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440852-dcb3-48ce-bb82-db4b20f25e92 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:20.942342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:20.943065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:20.943893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:20.944102 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:20.957411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:20.959588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253b9e-b168-417e-b8cb-8f42b2e8e62b service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:20.984625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:20.986990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.008797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c58e6d-b4e0-4656-8e52-5a2cde0a6bf1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.014194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.016594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1111/2230] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:21.017128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.017420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.017700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] PATH_INFO: `/v3/projects/f44cf27053ee41a08c6b9af77887b682` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.019132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44cf27053ee41a08c6b9af77887b682)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.021142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.095683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44cf27053ee41a08c6b9af77887b682', 'request_id': 'req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.139732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44cf27053ee41a08c6b9af77887b682', 'request_id': 'req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.156916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44cf27053ee41a08c6b9af77887b682', 'request_id': 'req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.181680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] The token cache is being invalidate because project f44cf27053ee41a08c6b9af77887b682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:21.181978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.190374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-f52f949c-f23d-4cb9-8c7a-7fba11b75fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.196222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1120/2231] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:20 2021] DELETE /identity/v3/projects/f44cf27053ee41a08c6b9af77887b682 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:21.198546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.198849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.199131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.241497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:21.243538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.347085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1112/2232] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:21.348156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.348548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.348895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.368886 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:21.370528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.380049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1121/2233] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:21.384231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.409394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a99a2-6dd8-442b-9d74-5e00adcdbd25 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.425501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.426192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.426473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.426798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.428057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:21.428057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.432103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.456615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1113/2234] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:21.460878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.476576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6d497-cd0c-40f4-8d4b-1994160a3102 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.481378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.482054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.482340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.482652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.483402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.486730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.526967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1122/2235] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:21 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:21.531092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.541303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1814e2-b068-4071-82f6-8cce362a6d68 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.580099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.582742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.622797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.623523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.623833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.624163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.625453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.627730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.656230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1114/2236] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:21 2021] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:21.660376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.672761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0c7ea-63c8-4c6d-ade9-9dd49f43d018 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.678127 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.679075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.679586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.679941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.680967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.683061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.698749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1115/2237] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:21.701422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.705254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde85a6-a0e9-457e-ab52-a5e7e1aae94c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.711929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.713482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.713792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.714050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] PATH_INFO: `/v3/projects/d18bfb2d18b442269417cd4a1ed0a220` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.714682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f95a-e14f-4fa6-b367-781844be3799 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.715503 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18bfb2d18b442269417cd4a1ed0a220)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.717507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.720550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.721246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.721533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.721811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.722609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.724262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.737023 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1116/2238] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:21 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:21.740983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.759846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707d0e-0009-4889-9fd5-59a8170dc648 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.768580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.770123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.771460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.771754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] PATH_INFO: `/v3/projects/79aac25b1dae45b7a993746289e7fda1/users/ab89f25d56da49a1b966ce66a67a15f5/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.786705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18bfb2d18b442269417cd4a1ed0a220', 'request_id': 'req-17596ba0-498f-4004-ba09-1cbc0f701f64'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.793888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18bfb2d18b442269417cd4a1ed0a220', 'request_id': 'req-17596ba0-498f-4004-ba09-1cbc0f701f64'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.799088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79aac25b1dae45b7a993746289e7fda1, user_id=ab89f25d56da49a1b966ce66a67a15f5, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.802834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18bfb2d18b442269417cd4a1ed0a220', 'request_id': 'req-17596ba0-498f-4004-ba09-1cbc0f701f64'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.803720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d26da-8b4a-46f8-a8b1-34505ed24a0b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:21.821966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] The token cache is being invalidate because project d18bfb2d18b442269417cd4a1ed0a220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:21.822668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.823735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:21.829163 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1123/2240] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:21 2021] DELETE /identity/v3/projects/d18bfb2d18b442269417cd4a1ed0a220 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:21.830353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.831976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.835279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1117/2240] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:21 2021] PUT /identity/v3/projects/79aac25b1dae45b7a993746289e7fda1/users/ab89f25d56da49a1b966ce66a67a15f5/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:21.837045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.837346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.837630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.874954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] MFA Rules not processed for user `ab89f25d56da49a1b966ce66a67a15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:21.877313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.913627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596ba0-498f-4004-ba09-1cbc0f701f64 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:21.964895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1118/2241] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:21.974592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:21.976220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:21.989653 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:21.991009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:21.991585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:21.992084 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] PATH_INFO: `/v3/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:21.993705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4b5f31ef3d423a9ed423ce2ed5c1fe)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:21.996714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:22.056512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0533ed9-fb46-4f3e-b7ee-949a0f4f352e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:22.062751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:22.064140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.064140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.064414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.070793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4b5f31ef3d423a9ed423ce2ed5c1fe'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.073085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4b5f31ef3d423a9ed423ce2ed5c1fe'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.074349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4b5f31ef3d423a9ed423ce2ed5c1fe'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.081648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:22.083185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:22.094241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1119/2242] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:21 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:22.100100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4b5f31ef3d423a9ed423ce2ed5c1fe'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.111129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d5d6466e-6bc7-40fb-94f5-2074608979b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4b5f31ef3d423a9ed423ce2ed5c1fe'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.120002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:22.121814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:22.131915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1124/2243] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:21 2021] DELETE /identity/v3/users/8f4b5f31ef3d423a9ed423ce2ed5c1fe => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:22.137733 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34d27-7719-41f5-911b-c77a9975d9ba service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:22.216804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:22.217934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.218281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.218658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] PATH_INFO: `/v3/users/ab89f25d56da49a1b966ce66a67a15f5` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.221816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab89f25d56da49a1b966ce66a67a15f5)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:22.225900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:22.304936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab89f25d56da49a1b966ce66a67a15f5'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.306948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab89f25d56da49a1b966ce66a67a15f5'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.323708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab89f25d56da49a1b966ce66a67a15f5'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.357252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab89f25d56da49a1b966ce66a67a15f5'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.371790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab89f25d56da49a1b966ce66a67a15f5'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.386123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1120/2244] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:22 2021] DELETE /identity/v3/users/ab89f25d56da49a1b966ce66a67a15f5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:22.390869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.391551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.392099 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.427339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:22.429065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:22.543648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1125/2245] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:22.571550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:22.573019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:22.693420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:22.694932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:22.700438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3f831-46e3-4053-b848-ab47a44f1505 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:22.717210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:22.721673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.722258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.722752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.729906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef8539-9357-4107-98f3-947b7825c913 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:22.741070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:22.741956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.742245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.742549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] PATH_INFO: `/v3/projects/2a5013e14f194a8a877a64186c375841` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.743883 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5013e14f194a8a877a64186c375841)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:22.746041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:22.747210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:22.754078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946a2d3-47ab-49d4-bebf-99973db3c3fc service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:22.790684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1121/2246] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:22.837738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5013e14f194a8a877a64186c375841', 'request_id': 'req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.846807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5013e14f194a8a877a64186c375841', 'request_id': 'req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.854713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5013e14f194a8a877a64186c375841', 'request_id': 'req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.875560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] The token cache is being invalidate because project 2a5013e14f194a8a877a64186c375841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:22.876297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.877250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a78be7ea-5df4-4b0e-8c4e-fc6bf753b89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:22.880050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1126/2247] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:22 2021] DELETE /identity/v3/projects/2a5013e14f194a8a877a64186c375841 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:22.887498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:22.887807 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:22.888141 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:22.915529 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:22.916893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.053004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1122/2248] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:23.055262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.055784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.056278 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.086903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:23.088651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.109623 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.114751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1127/2249] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:23.122298 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa740d6-929a-41c8-b36c-a2cfab6ddd2b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.128390 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.129280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.129736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.130203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.131319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:23.131847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.133691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.154877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1123/2250] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:23.159785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.173371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bb103-42dd-440e-a20b-f0ff089bf632 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.181442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.182560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.183008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.183821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.185079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.188931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.223252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.225025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.229980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1128/2251] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:23.234295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.253804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b2c-1780-4fef-9d29-344818706d7a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.346674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b6189-fa78-49cc-883e-e438d9dd0d58 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.352956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.353655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.353939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.354221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.355006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.355160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.356242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.356771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.357083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.357503 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] PATH_INFO: `/v3/projects/79aac25b1dae45b7a993746289e7fda1` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.367615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79aac25b1dae45b7a993746289e7fda1)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.373992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.385046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1129/2252] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:44:23.390430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.414648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8fa7e-9250-4e33-82c5-61efe85e2677 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.427498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.429195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.429765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.430326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.435359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.440866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.463310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1130/2253] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:23.467812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.469071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79aac25b1dae45b7a993746289e7fda1', 'request_id': 'req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:23.476642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79aac25b1dae45b7a993746289e7fda1', 'request_id': 'req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:23.479223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c5b0f-9a80-4663-bf5c-9088b2ec7444 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.487020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79aac25b1dae45b7a993746289e7fda1', 'request_id': 'req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:23.505924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] The token cache is being invalidate because project 79aac25b1dae45b7a993746289e7fda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:23.506213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:23.506933 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f1e3d72f-5443-4b8e-adb4-a3dbce6b7c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:23.508828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1124/2254] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:23 2021] DELETE /identity/v3/projects/79aac25b1dae45b7a993746289e7fda1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:23.516859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.517180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.517431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.541085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:23.541784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.565725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.566451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.566753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.567027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.567863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.569949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d76187-d776-4cb9-b617-fcd13421f8e6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.590551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1131/2255] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:23 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:23.595345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ad11-b797-4ecf-a0ea-4c65dee2bd09 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.595644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ad11-b797-4ecf-a0ea-4c65dee2bd09 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.595924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ad11-b797-4ecf-a0ea-4c65dee2bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.630884 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8669ad11-b797-4ecf-a0ea-4c65dee2bd09 None None] MFA Rules not processed for user `f262d208d53949b8a1836c8aa4fc3376`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:23.632105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8669ad11-b797-4ecf-a0ea-4c65dee2bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.702558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1125/2256] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:23.702558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.702558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.725079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3c79c-73df-40f1-9160-52fa7745a1c5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.730167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.731119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.731407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.731682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] PATH_INFO: `/v3/projects/05d7cd2048ef4d7e9e6372458695d909/users/b4b7ac7bf7974724abdb59fd51b1dd0d/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.741053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1132/2257] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:23.747013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.747332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.747692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.755955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d7cd2048ef4d7e9e6372458695d909, user_id=b4b7ac7bf7974724abdb59fd51b1dd0d, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.759108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.768839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:23.770284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.781179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1133/2258] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:23.785762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.787413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:23.794321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1126/2259] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:23 2021] PUT /identity/v3/projects/05d7cd2048ef4d7e9e6372458695d909/users/b4b7ac7bf7974724abdb59fd51b1dd0d/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:23.796956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.801184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e639e88-1eac-4637-bc8e-37c423154145 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.884208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.885397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.886550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.886550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.887868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.891849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc486db-ca7f-48e2-b7b6-41061a8e9095 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.904813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340f2ea-9f8a-4d4b-965b-14a7e318259b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.911162 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:23.912038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.912213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.912364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.913119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:23.913424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:23.915087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:23.929368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1134/2260] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:23.930800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:23.931096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:23.931365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:23.935062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1127/2261] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:23.938744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:23.956819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c89c-6c90-4987-a6ae-91b5a29e69a5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:23.973199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] MFA Rules not processed for user `b4b7ac7bf7974724abdb59fd51b1dd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:23.974915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:24.049067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.049994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.050309 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.050938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.051318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.053461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.068710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1135/2262] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:24.069819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.081650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1128/2263] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:23 2021] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:24.082890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.097182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5062-7907-4629-ad30-ad2f009fdb5c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.103200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.104113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.104944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.105378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.106307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.106935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d14c9-63d0-42a1-9547-0ac71ae79acf None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.109367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.113235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.113994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.114351 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.114863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.115646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.117740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.153113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1129/2264] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:24.154296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.164478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1136/2265] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:24.165905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.245283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48827499-1846-441d-9fb0-8b8ecdc29f9c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.286124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc97c1-218d-4e29-b349-f5d460d97072 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.291718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.292502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.292793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.293071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.293827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.296012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.326799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1137/2266] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:24.327943 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.328358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.328705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.329050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.329515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.330478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.332183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.341849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815739-ec6e-4124-89e0-f546b74dfc48 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.345769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1130/2267] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.346773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.349509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.350204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.350542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.350829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.351549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.353625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.364192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d73b-85e6-4bab-aa30-1667dbf782a3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.370958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.371747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.372033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.372523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.373124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.376948 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.381386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1138/2268] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:24.382660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.394342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1131/2269] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.394592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91031-a23a-491c-af73-2de3ece11e49 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.395957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.402219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.403758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.404304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.404747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] PATH_INFO: `/v3/projects/0071d1b0afe94143ad5ba7328569708e/users/7f2dd949a95743ae9445a1e3300dfbde/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.409544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec6af1-0b76-4216-9589-bd8f39743781 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.416212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.417738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.418260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.419535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.420032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.423269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.431000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0071d1b0afe94143ad5ba7328569708e, user_id=7f2dd949a95743ae9445a1e3300dfbde, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.435122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1132/2270] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.435767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.439706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.453565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee9fb-9db7-4f80-b158-c3590552bf1a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.465946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1139/2271] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:24 2021] PUT /identity/v3/projects/0071d1b0afe94143ad5ba7328569708e/users/7f2dd949a95743ae9445a1e3300dfbde/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:24.466863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.555137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.556060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.556356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.556641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] PATH_INFO: `/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3/users/3e4eac8e0785494889aacb843cf5f9a0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.562723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe3501-de10-4ff2-80ea-95b31145eca2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.567698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.568454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.568659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.568927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.569775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.571551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.586367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1140/2272] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.586367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.586804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1416e4cef2e45d4b972fdc6601ec6e3, user_id=3e4eac8e0785494889aacb843cf5f9a0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.590467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.600808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e40f2-de3b-4083-837a-d1abd32c9fea admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.611326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1133/2273] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:24 2021] PUT /identity/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3/users/3e4eac8e0785494889aacb843cf5f9a0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:24.613104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.692373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.692373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.693505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.693505 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.694085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.695621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.709405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1141/2274] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.710552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.717931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644419-c443-4d61-bf1b-1876f553c149 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.727481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.728853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.729281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.729709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] PATH_INFO: `/v3/projects/51ec25e883be46a4aef86eb7bdc3f9bd/users/a6c274fca4d046eb870c932118c44074/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.735340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d299-fce7-4529-957d-6174d2273692 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.741272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.741983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.742251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.742567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.743330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.745055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.754138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ec25e883be46a4aef86eb7bdc3f9bd, user_id=a6c274fca4d046eb870c932118c44074, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.758596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.759847 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1142/2275] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:24.763626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.778026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d40d02-2ca6-4763-8b27-fd621acb7604 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.783056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1134/2276] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:24 2021] PUT /identity/v3/projects/51ec25e883be46a4aef86eb7bdc3f9bd/users/a6c274fca4d046eb870c932118c44074/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:24.784471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:24.873887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.875676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.876250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.876687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] PATH_INFO: `/v3/projects/0071d1b0afe94143ad5ba7328569708e/users/7f2dd949a95743ae9445a1e3300dfbde/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.883330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0071d1b0afe94143ad5ba7328569708e, user_id=7f2dd949a95743ae9445a1e3300dfbde, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.886074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac22b0-999d-4a9f-be16-2868a19f52d5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.889007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4797973-20e5-4496-8564-4177783f9cca admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:24.902675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1143/2277] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:24 2021] PUT /identity/v3/projects/0071d1b0afe94143ad5ba7328569708e/users/7f2dd949a95743ae9445a1e3300dfbde/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:24.903560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:24.904558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.904794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.904917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.905101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] PATH_INFO: `/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3/users/3e4eac8e0785494889aacb843cf5f9a0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.906217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.906707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.912688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1416e4cef2e45d4b972fdc6601ec6e3, user_id=3e4eac8e0785494889aacb843cf5f9a0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:24.916589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f668a7-f801-4ff5-bae7-5c60a7a21adb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:24.933255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1135/2278] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:24 2021] PUT /identity/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3/users/3e4eac8e0785494889aacb843cf5f9a0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:24.956252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1387-575d-4207-9236-84fa42764077 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:24.956632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1387-575d-4207-9236-84fa42764077 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:24.957311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1387-575d-4207-9236-84fa42764077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:24.967757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] MFA Rules not processed for user `a6c274fca4d046eb870c932118c44074`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:24.969213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:25.008378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c20f1387-575d-4207-9236-84fa42764077 None None] MFA Rules not processed for user `3e4eac8e0785494889aacb843cf5f9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:25.009876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c20f1387-575d-4207-9236-84fa42764077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:25.085991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1144/2279] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:25.100300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:25.103658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:25.214224 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1136/2280] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:24 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:25.242026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1387-575d-4207-9236-84fa42764077 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:25.243874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c20f1387-575d-4207-9236-84fa42764077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:25.266748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713534d-ab41-4f37-9938-3861f0212925 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:25.272422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:25.273179 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:25.273583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:25.273958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:25.289535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:25.291321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:25.305913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1145/2281] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:25 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:25.368677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1387-575d-4207-9236-84fa42764077 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:25.373607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:25.375358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:25.375803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:25.376380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:25.393158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:25.395912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:25.429928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1137/2282] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:25 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:25.536888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:25.554518 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefe212-c5c2-4476-99be-c2897565522e service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:25.560431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:25.563549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:25.563906 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:25.565609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:25.712296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:25.714669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d90ac-4d8d-445e-83c5-7af8bec836e6 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:25.738960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1146/2283] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:25 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:26.183790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:26.279106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e9e79-4416-4789-9101-6a83c0d60bc9 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:26.290429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:26.291669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:26.291957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:26.292237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] PATH_INFO: `/v3/users/b4b7ac7bf7974724abdb59fd51b1dd0d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:26.294026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b7ac7bf7974724abdb59fd51b1dd0d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:26.296909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:26.382202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b7ac7bf7974724abdb59fd51b1dd0d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:26.383025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b7ac7bf7974724abdb59fd51b1dd0d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:26.391492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b7ac7bf7974724abdb59fd51b1dd0d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:26.413585 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b7ac7bf7974724abdb59fd51b1dd0d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:26.426374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b7ac7bf7974724abdb59fd51b1dd0d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:26.441685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1138/2284] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:26 2021] DELETE /identity/v3/users/b4b7ac7bf7974724abdb59fd51b1dd0d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:26.448181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:26.448492 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:26.448756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:26.475361 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:26.477158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:26.563142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1147/2285] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:26.574240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:26.576546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:26.656630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12096b3-b66f-4fd6-beff-9e959b8e9bd5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:26.665376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:26.666336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:26.666832 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:26.667263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:26.687985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:26.694238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:26.708282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1139/2286] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:27.218252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:27.225556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:27.268770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7051d2-d42d-44ff-b35c-464f0e487c34 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:27.286798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:27.290953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:27.291650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:27.294435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] PATH_INFO: `/v3/projects/05d7cd2048ef4d7e9e6372458695d909` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:27.297364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d7cd2048ef4d7e9e6372458695d909)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:27.301266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:27.440806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d7cd2048ef4d7e9e6372458695d909', 'request_id': 'req-a1117bd3-17ed-4c1f-91c0-cce452aba414'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.448311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d7cd2048ef4d7e9e6372458695d909', 'request_id': 'req-a1117bd3-17ed-4c1f-91c0-cce452aba414'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.463020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d7cd2048ef4d7e9e6372458695d909', 'request_id': 'req-a1117bd3-17ed-4c1f-91c0-cce452aba414'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.485509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] The token cache is being invalidate because project 05d7cd2048ef4d7e9e6372458695d909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:27.485861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.486738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.491560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1148/2287] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:27 2021] DELETE /identity/v3/projects/05d7cd2048ef4d7e9e6372458695d909 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:27.492966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:27.506356 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77062e65-2ac1-4439-a6f6-71f4981ad132 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:27.637019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:27.638593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:27.640221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:27.640578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] PATH_INFO: `/v3/users/3e4eac8e0785494889aacb843cf5f9a0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:27.643258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4eac8e0785494889aacb843cf5f9a0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:27.652683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:27.788088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4eac8e0785494889aacb843cf5f9a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.788781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4eac8e0785494889aacb843cf5f9a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.798018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4eac8e0785494889aacb843cf5f9a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.814826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4eac8e0785494889aacb843cf5f9a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.827831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-eed878cb-ba93-47b5-a901-b56b27056a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4eac8e0785494889aacb843cf5f9a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:27.838287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1140/2288] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:27 2021] DELETE /identity/v3/users/3e4eac8e0785494889aacb843cf5f9a0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:28.259543 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:28.261101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:28.298186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117bd3-17ed-4c1f-91c0-cce452aba414 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:28.426772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:28.427782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:28.428117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:28.428468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] PATH_INFO: `/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:28.430941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1416e4cef2e45d4b972fdc6601ec6e3)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:28.451027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:28.539796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1416e4cef2e45d4b972fdc6601ec6e3', 'request_id': 'req-a4337b3d-acfb-406a-9143-2ed997141d1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:28.549689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1416e4cef2e45d4b972fdc6601ec6e3', 'request_id': 'req-a4337b3d-acfb-406a-9143-2ed997141d1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:28.561221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1416e4cef2e45d4b972fdc6601ec6e3', 'request_id': 'req-a4337b3d-acfb-406a-9143-2ed997141d1a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:28.589721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] The token cache is being invalidate because project b1416e4cef2e45d4b972fdc6601ec6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:28.590832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:28.594119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a4337b3d-acfb-406a-9143-2ed997141d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:28.599136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1149/2289] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:28 2021] DELETE /identity/v3/projects/b1416e4cef2e45d4b972fdc6601ec6e3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:28.605530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:28.606779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:28.607331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:28.649089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:28.650406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:28.738244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1141/2290] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:28.746590 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:28.746879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:28.747159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:28.773947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:28.776232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:28.804002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1150/2291] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:28.808263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:28.829073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55818-7275-444e-9628-3fb94bb06214 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:28.838157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:28.839253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:28.840092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:28.840638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:28.841897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:28.841897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:28.844463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:28.878554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1142/2292] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:28.886389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:28.899377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60282cdf-24f5-44e8-82f1-6148cdaef539 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:28.908308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:28.909525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:28.909819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:28.912235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:28.914904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:28.919680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:28.989047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1151/2293] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:28 2021] POST /identity/v3/projects => generated 359 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:28.993769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:29.019706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b470be-0478-4941-abf5-1d319fb4a62c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:29.217843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:29.219929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:29.240314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:29.241203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:29.242377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:29.250440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:29.299993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:29.300989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1143/2294] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:28 2021] POST /identity/v3/users => generated 280 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:29.355005 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c13a03-8e5f-4c96-9ad9-5102ea1fd9d2 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:29.419253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:29.421003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:29.421952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:29.422724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:29.424490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:29.429199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:29.476231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1152/2295] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:29.481115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:29.497204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1ad22-ca61-444a-9903-02d7c6be7e97 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:29.515661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:29.516537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:29.516822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:29.517098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:29.518112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:29.519517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5a35d-696c-4736-a515-d754d4c010c8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:29.587073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1144/2296] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:29.593890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:29.625459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b62de4-7854-40cf-a624-958628e4df44 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:29.634471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:29.637730 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:29.638348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:29.639009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] PATH_INFO: `/v3/projects/07f2510873a84e7a8e97cfb006bd7ca2/users/f0843aec57c34cefafb3a81f25fe2523/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:29.717824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f2510873a84e7a8e97cfb006bd7ca2, user_id=f0843aec57c34cefafb3a81f25fe2523, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:29.728760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:29.810634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1153/2297] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:29 2021] PUT /identity/v3/projects/07f2510873a84e7a8e97cfb006bd7ca2/users/f0843aec57c34cefafb3a81f25fe2523/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:29.822117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:29.822705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:29.822705 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:29.904328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] MFA Rules not processed for user `f0843aec57c34cefafb3a81f25fe2523`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:29.905471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:30.103458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1145/2298] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:29 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:30.281315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:30.296605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:30.477581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce15edd-ff48-4e00-a19b-6ec6b18b293c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:30.484533 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:30.485626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:30.486010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:30.486393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:30.525913 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:30.528327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c95ef-a803-4223-8525-211c0863ef1b service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:30.540092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1154/2299] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:30 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:30.556215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:30.741276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c99165-90c3-48ae-a866-4718d421c49b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:30.754329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:30.755359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:30.755791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:30.758101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] PATH_INFO: `/v3/users/f0843aec57c34cefafb3a81f25fe2523` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:30.760783 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0843aec57c34cefafb3a81f25fe2523)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:30.764967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:30.889826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0843aec57c34cefafb3a81f25fe2523'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:30.892002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0843aec57c34cefafb3a81f25fe2523'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:30.916419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0843aec57c34cefafb3a81f25fe2523'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:30.945079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0843aec57c34cefafb3a81f25fe2523'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:30.966000 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0843aec57c34cefafb3a81f25fe2523'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:30.976512 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1146/2300] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:44:30 2021] DELETE /identity/v3/users/f0843aec57c34cefafb3a81f25fe2523 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:30.982375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:30.982723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:30.983124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:31.019162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:31.023043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:31.137559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1155/2301] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:31.157020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:31.158889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:31.249839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f3bdc-ce44-424d-ae14-b6122fa05e8e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:31.256767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:31.256767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:31.256767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:31.256767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:31.298969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:31.304352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c219b-1f66-49f5-9ffd-c5bf399502fe service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:31.330606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1147/2302] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:32.216895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:32.225127 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:32.265864 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e33e0-0bc2-455e-8479-dea6481e3cf8 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:32.318415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:32.319817 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:32.320595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:32.334944 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] PATH_INFO: `/v3/projects/07f2510873a84e7a8e97cfb006bd7ca2` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:32.340459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f2510873a84e7a8e97cfb006bd7ca2)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:32.351519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:32.454320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f2510873a84e7a8e97cfb006bd7ca2', 'request_id': 'req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:32.477738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f2510873a84e7a8e97cfb006bd7ca2', 'request_id': 'req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:32.497524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f2510873a84e7a8e97cfb006bd7ca2', 'request_id': 'req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:32.531405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] The token cache is being invalidate because project 07f2510873a84e7a8e97cfb006bd7ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:44:32.531693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:32.532940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5a77bd9f-54f3-43ec-b5c6-6e92697be97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:44:32.541721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1156/2303] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:44:32 2021] DELETE /identity/v3/projects/07f2510873a84e7a8e97cfb006bd7ca2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:44:32.544129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:32.544781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:32.544781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:32.571555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:32.573883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:32.728447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1148/2304] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:32.738900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:32.739199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:32.739481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:32.771744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:32.775079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:32.810788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1157/2305] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:32.816457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:32.834118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643410dd-07a1-416e-a159-b4e61eeb2720 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:32.846205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:32.846739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:32.847706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:32.847983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:32.848762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:44:32.849061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:32.851447 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:32.909653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1149/2306] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:44:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:44:32.913475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:32.933515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c966b-4798-454c-96a7-2af1dd9e2165 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:32.947151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:32.950486 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:32.952286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:32.953217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:32.954582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:32.959750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.026745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1158/2307] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:44:32 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:33.028292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.049237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202b342-87db-43ad-942b-123ee3ecc738 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.231007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.232856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.233238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.233916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.236207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.239358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeee4cd-d922-4d99-af37-9f1e4d5d7734 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.274748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1150/2308] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:44:33 2021] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:44:33.280509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.291303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.291848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.292433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.299192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edea50-6e41-41a7-a057-22537bd94031 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.322936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.324191 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.324861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.325560 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.327153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.331305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.354452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1159/2309] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:44:33.358625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] MFA Rules not processed for user `7f2dd949a95743ae9445a1e3300dfbde`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:33.360538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:33.362131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.405362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1d7a-9831-4230-9913-72eafcf7ab86 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.412197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.413031 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.413392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.413741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.414844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.417280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.429880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1160/2310] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:44:33 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:44:33.435530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.452479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65074123-069c-4c60-826f-bd6ac873ef31 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.459782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.460741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.461188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.461709 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] PATH_INFO: `/v3/projects/ef418ef66e804790a08f4acecb01f4da/users/d92593875d744077a6f2ee4a08040ddb/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.474843 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1151/2311] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:33 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:33.483676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.485278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:33.487418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef418ef66e804790a08f4acecb01f4da, user_id=d92593875d744077a6f2ee4a08040ddb, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.495156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8347-7b4f-4481-b54b-1ca4894c338f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.552045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1161/2312] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:44:33 2021] PUT /identity/v3/projects/ef418ef66e804790a08f4acecb01f4da/users/d92593875d744077a6f2ee4a08040ddb/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:44:33.556502 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.557200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.557776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.595984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad32c3-8d01-40f0-a20d-541886552693 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.598244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] MFA Rules not processed for user `d92593875d744077a6f2ee4a08040ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:33.599581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:33.695580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1162/2313] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:33 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:44:33.708209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:33.710589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:33.737217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.737880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.738170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.738443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.747871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:33.810098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33078d-f225-4a93-a870-8415aa1c7209 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:33.819623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:33.820744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:33.821219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:33.821717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:33.837790 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.840473 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ab388-5e3e-4578-945a-c195f2dffcb0 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.865388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1163/2314] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:33.887567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:33.889673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:33.908950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1152/2315] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:33 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:44:35.495767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:35.496266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:35.496365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:35.516796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] MFA Rules not processed for user `f262d208d53949b8a1836c8aa4fc3376`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:44:35.518060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:35.525806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1164/2316] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:44:35 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:44:52.526136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:52.528583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:52.610471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe628-835c-4a93-805d-7fd3e7e23b3d service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:52.615107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:52.615815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:52.616101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:52.616380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:52.618803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:52.638082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:52.639872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:52.652914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1153/2317] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:44:52.788380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:44:52.806860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367a973-05c6-42ff-987a-af6828b1007d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:44:52.810851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:44:52.811540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:44:52.811813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:44:52.812095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:44:52.814146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:44:52.831949 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:44:52.833511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:44:52.851930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1165/2318] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:44:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:03.522060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:03.544323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9bbc-04e8-43ee-ad8c-475cfb345ec5 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:03.550343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:03.550900 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:03.551227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:03.551439 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:03.553254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:03.613225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:03.614921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:03.624556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1154/2319] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:05.672683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:05.674092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:05.688198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78951700-76dc-4527-8662-a9438daca146 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:05.693853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:05.694490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:05.694808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:05.695091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:05.696844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:05.754939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:05.756612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b20eb6-272d-4a62-94c9-43f06c57ea7d service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:05.766844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1166/2320] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:05 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:07.405118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:07.468978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77b8b-0e43-4fc7-9087-aaba9482e6af service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:07.473829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:07.474876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:07.475163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:07.475440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] PATH_INFO: `/v3/users/d92593875d744077a6f2ee4a08040ddb` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:07.476653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92593875d744077a6f2ee4a08040ddb)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:07.478656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:07.525580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92593875d744077a6f2ee4a08040ddb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:07.526228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92593875d744077a6f2ee4a08040ddb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:07.533590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92593875d744077a6f2ee4a08040ddb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:07.545184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92593875d744077a6f2ee4a08040ddb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:07.552473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92593875d744077a6f2ee4a08040ddb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:07.558574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1155/2321] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:45:07 2021] DELETE /identity/v3/users/d92593875d744077a6f2ee4a08040ddb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:07.563252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:07.563774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:07.563873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:07.581507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:07.582909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:07.643888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1167/2322] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:07.655071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:07.656461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:07.727833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78fb7-fed1-4050-a866-7a621eef6bbc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:07.731484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:07.732183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:07.732467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:07.732746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:07.741931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:07.743401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2e3e2-88e2-4848-98cd-1c825041cb4b service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:07.753539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1156/2323] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:08.016284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.017729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:08.030060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b53d71-d010-481a-aec3-2db660c249f6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.034745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.035637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.035921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.036276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] PATH_INFO: `/v3/projects/ef418ef66e804790a08f4acecb01f4da` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.037441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef418ef66e804790a08f4acecb01f4da)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.039400 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.089238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef418ef66e804790a08f4acecb01f4da', 'request_id': 'req-b18c6f0a-4d83-4011-9441-20eb061b865b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:08.095780 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef418ef66e804790a08f4acecb01f4da', 'request_id': 'req-b18c6f0a-4d83-4011-9441-20eb061b865b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:08.101970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef418ef66e804790a08f4acecb01f4da', 'request_id': 'req-b18c6f0a-4d83-4011-9441-20eb061b865b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:08.116654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] The token cache is being invalidate because project ef418ef66e804790a08f4acecb01f4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:45:08.116950 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:08.117629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-b18c6f0a-4d83-4011-9441-20eb061b865b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:08.119411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1168/2324] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:45:08 2021] DELETE /identity/v3/projects/ef418ef66e804790a08f4acecb01f4da => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:08.127187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.127615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.127963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.145509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:08.146851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:08.209765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1157/2325] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:08.218433 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.218762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.219038 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.238264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:08.239497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:08.251779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1169/2326] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:08.252989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.262490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1ae8e-18c8-488a-9591-8e186a7763fe None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.267744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.268483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.268894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.269177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.269922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:45:08.270231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.271868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.285289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1158/2327] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:45:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:45:08.289755 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.299815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c125-c14a-47c0-8c96-13af2f59e6da None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.304729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.305409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.305694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.305969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.306715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.308618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.338680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1170/2328] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:45:08 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:45:08.339815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.350142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055f1d-e2e7-4313-9001-c373a84dbdcb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.414029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.414945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.415049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.415277 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.415994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.417921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.442349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1159/2329] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:45:08 2021] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:45:08.443621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.454736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb661c7-57cb-469a-8c8c-5c88f1d93a1c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.462540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.463218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.463496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.463770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.464525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.466262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.479258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1171/2330] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:08 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:45:08.483756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.494628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55178c8-47fb-4113-ba67-9a91acb1fa0c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.499979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.500668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.500965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.501244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.501989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.503768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71746056-8b6a-4e86-b072-5955d013c004 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.515194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1160/2331] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:45:08.519642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.529998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d072d-965d-48b5-be1c-41fa1f2b9386 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.534831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.535703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.535987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.536293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] PATH_INFO: `/v3/projects/5b085f0d44d04b11b20b44010afd41b9/users/381ada4fec104c9e828602c6553931cd/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.551299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b085f0d44d04b11b20b44010afd41b9, user_id=381ada4fec104c9e828602c6553931cd, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.554048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.567106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1172/2332] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:45:08 2021] PUT /identity/v3/projects/5b085f0d44d04b11b20b44010afd41b9/users/381ada4fec104c9e828602c6553931cd/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:08.577489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.577799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.578130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.609060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] MFA Rules not processed for user `381ada4fec104c9e828602c6553931cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:08.610313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:08.672870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1161/2333] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:08 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:08.684644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:08.686447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:08.746908 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65bd5b-eddf-4960-88bf-5e20c48ec08a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:08.751064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:08.751732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:08.751999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:08.752278 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:08.763551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:08.764995 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab3c3-e8d5-4dd1-bf86-9726e8f5948a service glance] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:08.773819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1173/2334] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:08 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:11.049330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:11.050932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:11.113539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd039-ca6c-4870-bf9a-5eba106b188d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:11.117367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:11.118021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:11.118306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:11.118635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:11.120410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:11.130955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:11.132389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:11.140495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1162/2335] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:13.036872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469952be-23df-42c2-917f-8bec06653de4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:13.037680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469952be-23df-42c2-917f-8bec06653de4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:13.037680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469952be-23df-42c2-917f-8bec06653de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:13.056307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-469952be-23df-42c2-917f-8bec06653de4 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:13.057786 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-469952be-23df-42c2-917f-8bec06653de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:13.114154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1174/2336] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:45:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:45:13.160889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:13.162478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:13.230670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e655a-54dc-442b-a59f-8dfc52f3a5ce service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:13.238079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:13.238759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:13.239049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:13.239327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:13.248086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:13.249850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:13.259374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1163/2337] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:45:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:45:18.558993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469952be-23df-42c2-917f-8bec06653de4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:18.590074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469952be-23df-42c2-917f-8bec06653de4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:18.595943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:18.596842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:18.597322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:18.597819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:18.599879 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:18.611393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:18.612969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:18.633061 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1175/2338] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:18 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:19.180777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:19.182736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:19.283350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6c88-3c06-43f2-a262-1cfa7bf0d07f service swift] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:19.288889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:19.289544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:19.289838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:19.290118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:19.292283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:19.306868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:19.308498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:19.319579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1164/2339] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:19 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:22.958734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:22.961093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:23.144381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ec4be-cced-442b-b99f-720d229e8ab9 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:23.150763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:23.151424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:23.152335 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:23.152787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:23.155363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:23.172697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:23.174760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d7cf1-7ae0-4f6a-9c01-38b3babb333b service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:23.199447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1176/2340] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:29.566175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:29.576427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930434c-a8d0-4073-bb82-4eabd4ebdc3e service placement] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:29.580150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:29.580797 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.581083 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.581360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.583160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:29.593275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:29.595014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2cc65-eb3f-40e0-a084-2c765d411bb2 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:29.602987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1165/2341] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:29.709328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.709328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.709328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.710176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1177/2342] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 08:45:29.717406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd287-944e-4cd3-a8f0-21214e3e7d60 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.717821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd287-944e-4cd3-a8f0-21214e3e7d60 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.718183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd287-944e-4cd3-a8f0-21214e3e7d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.756672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1a0fd287-944e-4cd3-a8f0-21214e3e7d60 None None] MFA Rules not processed for user `1a17f0cdeb07409f8439829dc145d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:29.757989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1a0fd287-944e-4cd3-a8f0-21214e3e7d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:29.769417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1166/2343] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:45:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:29.782255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:29.784001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:29.797619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10002e-43c4-438c-a539-0a338848bb9e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:29.801142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:29.801778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.802057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.802330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.813555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:29.815026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebcae6-62ad-446b-b704-014a0b2be62a service glance] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:29.825891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1178/2344] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:45:29.893330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cab9-23c9-42a0-a68c-7ee697a9e43d None None] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.893622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cab9-23c9-42a0-a68c-7ee697a9e43d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.893927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3cab9-23c9-42a0-a68c-7ee697a9e43d None None] PATH_INFO: `/` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.895809 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1167/2345] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:45:29.901326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d340b-1eb7-4bce-82c3-266d03988125 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.901615 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d340b-1eb7-4bce-82c3-266d03988125 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.901916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d340b-1eb7-4bce-82c3-266d03988125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.920657 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e84d340b-1eb7-4bce-82c3-266d03988125 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:29.921862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e84d340b-1eb7-4bce-82c3-266d03988125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:29.928406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1179/2346] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:45:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:29.941701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3cab9-23c9-42a0-a68c-7ee697a9e43d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:29.952941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3cab9-23c9-42a0-a68c-7ee697a9e43d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:29.956504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:29.957138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:29.957420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:29.957692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:29.964875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:29.966817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:29.975153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1168/2347] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:32.506269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:32.506796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:32.506907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:32.525393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:32.526604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:32.534353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1180/2348] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:45:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:32.548112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:32.561532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce9b4-16b5-479f-a1b0-7c039b848de0 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:32.566985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:32.567634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:32.567922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:32.568232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:32.577674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:32.579319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f50533-df22-4c63-a250-c5af26aab946 service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:32.587342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1169/2349] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:45:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:45:53.296288 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:53.297845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:53.363576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5113ab-788c-41b7-9ea5-e9339f7a53eb None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:53.368035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:53.368890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:53.369168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:53.369441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] PATH_INFO: `/v3/users/a6c274fca4d046eb870c932118c44074` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:53.371747 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c274fca4d046eb870c932118c44074)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:53.373663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:53.420045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c274fca4d046eb870c932118c44074'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:53.420713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c274fca4d046eb870c932118c44074'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:53.421324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c274fca4d046eb870c932118c44074'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:53.432717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c274fca4d046eb870c932118c44074'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:53.440075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c274fca4d046eb870c932118c44074'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:53.452785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1181/2350] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:45:53 2021] DELETE /identity/v3/users/a6c274fca4d046eb870c932118c44074 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:53.457553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:53.458067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:53.458067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:53.476263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:53.477476 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:53.543568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1170/2351] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:53.555262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:53.556723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:53.615609 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400107e-1dfc-40a2-8742-b9f0a3871c32 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:53.619287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:53.619927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:53.620208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:53.620504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:53.630836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:53.633425 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0391c83-bf03-4e80-aac7-aa2026014e6b service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:53.643272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1182/2352] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:45:53.965826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:53.969270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:53.987206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b5602-7167-4163-b6cc-f9ffc9afab27 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:53.992564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:53.993313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:53.993662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:53.993870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] PATH_INFO: `/v3/projects/51ec25e883be46a4aef86eb7bdc3f9bd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:53.995095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ec25e883be46a4aef86eb7bdc3f9bd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:53.997032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.042135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ec25e883be46a4aef86eb7bdc3f9bd', 'request_id': 'req-4b5a852a-6d94-4cb3-a350-a9044c856beb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.048912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ec25e883be46a4aef86eb7bdc3f9bd', 'request_id': 'req-4b5a852a-6d94-4cb3-a350-a9044c856beb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.054249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ec25e883be46a4aef86eb7bdc3f9bd', 'request_id': 'req-4b5a852a-6d94-4cb3-a350-a9044c856beb'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.066909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] The token cache is being invalidate because project 51ec25e883be46a4aef86eb7bdc3f9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:45:54.067200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.067822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-4b5a852a-6d94-4cb3-a350-a9044c856beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.069490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1171/2353] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:45:53 2021] DELETE /identity/v3/projects/51ec25e883be46a4aef86eb7bdc3f9bd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:54.076522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.076842 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.077126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.095888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:54.097611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:54.158587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1183/2354] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:54.166029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.166318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.166620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.186033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:54.187264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:54.195173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1172/2355] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:54.200583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.210220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131b80-850e-40cf-b92c-1b10f0d09b6b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.215059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.215716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.216002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.216383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.217137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:45:54.217619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.219523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.231509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1184/2356] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:45:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:45:54.235765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.245067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3387a4-d8db-45c7-9264-4478eb51ddec None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.251487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.252148 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.252435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.252712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.253419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.255351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.281682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1173/2357] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:45:54.285901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.296183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee71cd4-d66d-4601-b393-ab185fc52433 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.355130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.355806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.356089 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.356364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.357092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.359039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.380327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1185/2358] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:45:54.385091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.397722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79830e9-cba3-4152-bb83-b4b1f303eea3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.403150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.403824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.404111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.404389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.405164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.406885 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.420878 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1174/2359] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:45:54.424530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.436614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4b8a-73e5-4481-9793-edd766f7ce35 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.441457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.442189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.442546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.442860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.443661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.445381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65902c5e-c14e-4420-9fa4-bd5ad03ff4d8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.456514 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1186/2360] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:45:54.460607 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.471111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c372b8c-fcc3-43c4-918b-ef538f441592 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.475798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.476670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.476951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.477221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] PATH_INFO: `/v3/projects/e407a1cf7c174586998364bde73a83de/users/7c2541b8353d4ccbafaa45606c259c34/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.492627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e407a1cf7c174586998364bde73a83de, user_id=7c2541b8353d4ccbafaa45606c259c34, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.495330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.508825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1175/2361] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:45:54 2021] PUT /identity/v3/projects/e407a1cf7c174586998364bde73a83de/users/7c2541b8353d4ccbafaa45606c259c34/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:45:54.519869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.520158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.520439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.548115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] MFA Rules not processed for user `7c2541b8353d4ccbafaa45606c259c34`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:54.549329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:54.610847 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1187/2362] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:54.621936 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.623601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:54.681927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c096d6-99d1-4829-8b39-a3b34d31ba83 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.686480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.687164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.687448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.687724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.696768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.698303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcc141-b3f7-45e4-a0a8-c28d5029e3c5 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.708066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1176/2363] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:54 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:54.734961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:54.816488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2749-300b-43a9-a57e-d0ca47004b8b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:54.821963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:54.822881 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.823165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.823441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] PATH_INFO: `/v3/users/7c2541b8353d4ccbafaa45606c259c34` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.824870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2541b8353d4ccbafaa45606c259c34)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:54.826846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:54.875455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2541b8353d4ccbafaa45606c259c34'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.877620 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2541b8353d4ccbafaa45606c259c34'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.878286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2541b8353d4ccbafaa45606c259c34'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.894713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2541b8353d4ccbafaa45606c259c34'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.904402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2541b8353d4ccbafaa45606c259c34'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:54.923629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1188/2364] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:45:54 2021] DELETE /identity/v3/users/7c2541b8353d4ccbafaa45606c259c34 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:54.928969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:54.929921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:54.930338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:54.952745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:54.954971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.024478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1177/2365] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:45:55.034928 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.036480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.105463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bdf3b-cdae-44e9-9eb1-4fc8cfc18a53 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.110108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.111194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.111194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.111451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.121468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.123147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.133494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1189/2366] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:55.346182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.347937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.360539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27f37c-a500-47a6-acf7-7a717ad4514d None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.364427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.364967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.365252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.365531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.367432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.432811 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.434440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a8e36-8512-4c29-937b-f89baecfe4d1 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.444548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1178/2367] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:55 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:55.508611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.510172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.525035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64810842-8ae9-4731-bd0c-f70ff2aa2675 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.531525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.532402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.532688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.532972 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] PATH_INFO: `/v3/projects/e407a1cf7c174586998364bde73a83de` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.534219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e407a1cf7c174586998364bde73a83de)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.536240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.590451 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e407a1cf7c174586998364bde73a83de', 'request_id': 'req-c755c0a9-fe46-4c4d-b59f-f6d07a235023'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:55.596069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e407a1cf7c174586998364bde73a83de', 'request_id': 'req-c755c0a9-fe46-4c4d-b59f-f6d07a235023'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:55.602365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e407a1cf7c174586998364bde73a83de', 'request_id': 'req-c755c0a9-fe46-4c4d-b59f-f6d07a235023'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:55.617183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] The token cache is being invalidate because project e407a1cf7c174586998364bde73a83de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:45:55.617467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:55.618165 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-c755c0a9-fe46-4c4d-b59f-f6d07a235023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:55.619792 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1190/2368] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:45:55 2021] DELETE /identity/v3/projects/e407a1cf7c174586998364bde73a83de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:55.626407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.626941 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.627064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.645493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:55.647007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.708661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1179/2369] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:55.718459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.718776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.719051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.738907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:55.740152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:55.749799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1191/2370] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:45:55.754722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.765944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35485ef6-97bf-48cd-bc14-aa99b7cee8e1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.770671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.771365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.771675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.771960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.772722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:45:55.773128 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.775011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.793445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1180/2371] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:45:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:45:55.795788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.806982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6796e-fc34-4330-8381-c2700739ced1 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.812704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.813367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.813649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.813924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.815306 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.818297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.850627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1192/2372] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:45:55 2021] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:45:55.851735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.863272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6a4b9-11ae-4223-bcce-99678c9f22f3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.921834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.922787 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.923146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.923513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.924292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.926323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.947097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1181/2373] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:45:55 2021] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:45:55.951222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:55.962278 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c61d5-b7ba-48f7-afc3-3c52914fd32b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:55.970969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:55.971740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:55.972228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:55.972613 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:55.973454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:55.975192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:55.987827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1193/2374] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:45:55.992009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:56.003319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd099e-1102-448b-96c5-1f1005d8e1fe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:56.008788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:56.009521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.009882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.010282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.011594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:56.013587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592b066-5622-4f07-bb30-d8316c47d8b3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:56.024064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1182/2375] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:45:56.029227 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:56.039404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16879787-5115-438a-8892-1aacea26c370 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:56.045442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:56.045918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.046188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.046470 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] PATH_INFO: `/v3/projects/d2c56114da4a4fa19e37234b3e1574c6/users/c4c23bd2a67e453c91cca6c2d45edcf0/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.062888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c56114da4a4fa19e37234b3e1574c6, user_id=c4c23bd2a67e453c91cca6c2d45edcf0, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:56.065888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:56.086546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1194/2376] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:45:56 2021] PUT /identity/v3/projects/d2c56114da4a4fa19e37234b3e1574c6/users/c4c23bd2a67e453c91cca6c2d45edcf0/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:56.098300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.099088 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.099604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.131810 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] MFA Rules not processed for user `c4c23bd2a67e453c91cca6c2d45edcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:56.133222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:56.209075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1183/2377] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:56 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:56.222781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:56.224961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:56.286197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a2859-025e-448f-96c3-a865dad21afc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:56.290060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:56.290740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.291026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.291304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.303170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:56.305475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a74e-abc1-417e-a42f-39869daefc01 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:56.327118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1195/2378] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:56 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:56.612934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:56.614831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:56.699477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af26f3-c051-47ba-a314-ecb8782449b0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:56.711528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:56.712525 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.712880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.713235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] PATH_INFO: `/v3/users/381ada4fec104c9e828602c6553931cd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.714760 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=381ada4fec104c9e828602c6553931cd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:56.717508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:56.791332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381ada4fec104c9e828602c6553931cd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:56.792018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381ada4fec104c9e828602c6553931cd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:56.800427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381ada4fec104c9e828602c6553931cd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:56.815835 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381ada4fec104c9e828602c6553931cd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:56.823718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381ada4fec104c9e828602c6553931cd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:56.829769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1184/2379] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:45:56 2021] DELETE /identity/v3/users/381ada4fec104c9e828602c6553931cd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:45:56.834337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:56.834833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:56.834961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:56.852825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:56.854073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:56.921680 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1196/2380] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:56.960125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:56.961577 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.020617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d8426-5ece-413f-97a3-606fe17545bf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:57.024624 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:57.025282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.025569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.025848 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.036413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:57.037864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:57.048664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1185/2381] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:57.267688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:57.270080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.365536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdd418-056a-4973-802e-fd5f99b00daf None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:57.371783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:57.372478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.372764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.373051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.375271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.388093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:57.389712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e485ee8-8ec1-49ca-b861-84cac92fbe78 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:57.411664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1197/2382] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:45:57.530229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:57.531855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.545472 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fc2af-1033-4d93-a6b6-54cf5079880b service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:57.558133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:57.559097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.559388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.559669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] PATH_INFO: `/v3/projects/5b085f0d44d04b11b20b44010afd41b9` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.561004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b085f0d44d04b11b20b44010afd41b9)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:57.563152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:57.620988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b085f0d44d04b11b20b44010afd41b9', 'request_id': 'req-63379f97-f300-44d2-8815-eddb723d2b78'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:57.628962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b085f0d44d04b11b20b44010afd41b9', 'request_id': 'req-63379f97-f300-44d2-8815-eddb723d2b78'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:57.634609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b085f0d44d04b11b20b44010afd41b9', 'request_id': 'req-63379f97-f300-44d2-8815-eddb723d2b78'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:57.649839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] The token cache is being invalidate because project 5b085f0d44d04b11b20b44010afd41b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:45:57.651066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:57.652081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-63379f97-f300-44d2-8815-eddb723d2b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:45:57.655464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1186/2383] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:45:57 2021] DELETE /identity/v3/projects/5b085f0d44d04b11b20b44010afd41b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:57.662151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.662728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.663150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.684888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:57.686216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.765616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1198/2384] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:57.773412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.773795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.774039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.795275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:57.796499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:57.805299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1187/2385] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:57.809412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:57.829843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899556fa-a4cf-49ac-a873-71ffac2b3175 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:57.835404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789876-db48-4610-b807-b612769d7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:57.836073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789876-db48-4610-b807-b612769d7012 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.836358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789876-db48-4610-b807-b612769d7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.836781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09789876-db48-4610-b807-b612769d7012 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.837551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789876-db48-4610-b807-b612769d7012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:45:57.837859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789876-db48-4610-b807-b612769d7012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:57.840167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09789876-db48-4610-b807-b612769d7012 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:57.858671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1199/2386] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:45:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:45:57.859462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:57.869972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c59dc5-15a5-4c4f-9b15-cb7e92ada434 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:57.875735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:57.876657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:57.876947 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:57.877223 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:57.877944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:57.879981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:57.922488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1188/2387] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:45:57 2021] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:45:57.924210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789876-db48-4610-b807-b612769d7012 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:57.939522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09789876-db48-4610-b807-b612769d7012 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:58.025453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:58.026485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.027753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.028189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.029105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:58.031375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:58.066540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1200/2388] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:45:57 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:45:58.067663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:58.080187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152ac85-25cb-44c0-9fba-bd126d54422c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:58.088748 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:58.090113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.090679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.090938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.092061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:58.094292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:58.109009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1189/2389] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:45:58.113286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:58.124569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceedbeb-ec41-4c9b-a144-c2e35e8dc5eb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:58.129910 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:58.130651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.130940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.131218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.131983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:58.133889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32c4d0-6f79-4f76-99a7-33a1b465cfc5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:58.147073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1201/2390] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:45:58.151078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:58.161480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6045-1665-482d-b630-a64b5dbca775 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:58.166445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:58.167440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.167726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.168076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] PATH_INFO: `/v3/projects/e23a971ee0d64cbf893666cdbb514f7e/users/7d45dc24103d43f18f6bd08b283dc6b0/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.184735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23a971ee0d64cbf893666cdbb514f7e, user_id=7d45dc24103d43f18f6bd08b283dc6b0, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:58.187474 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:58.202883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1190/2391] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:45:58 2021] PUT /identity/v3/projects/e23a971ee0d64cbf893666cdbb514f7e/users/7d45dc24103d43f18f6bd08b283dc6b0/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:45:58.213221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.213510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.213787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.242006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] MFA Rules not processed for user `7d45dc24103d43f18f6bd08b283dc6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:45:58.243898 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:58.312498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1202/2392] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:45:58 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:45:58.322215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:45:58.324549 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:45:58.383565 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2c935-75b8-422d-ba08-eedce96a9ea1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:45:58.387791 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:45:58.388453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:45:58.388737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:45:58.389017 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:45:58.398376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:45:58.399863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10084-7a23-431c-805f-d116794fc36d service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:45:58.409642 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1191/2393] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:45:58 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:46:05.477530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:05.480139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:05.546136 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cc8a9-80dc-4cad-a5ad-34d6bd60e2b8 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:05.550810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:05.551668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:05.551955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:05.552284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] PATH_INFO: `/v3/users/c4c23bd2a67e453c91cca6c2d45edcf0` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:05.553475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c23bd2a67e453c91cca6c2d45edcf0)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:05.555499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:05.614096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c23bd2a67e453c91cca6c2d45edcf0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:05.615047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c23bd2a67e453c91cca6c2d45edcf0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:05.616252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c23bd2a67e453c91cca6c2d45edcf0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:05.632126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c23bd2a67e453c91cca6c2d45edcf0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:05.652818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c23bd2a67e453c91cca6c2d45edcf0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:05.664748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1203/2394] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:46:05 2021] DELETE /identity/v3/users/c4c23bd2a67e453c91cca6c2d45edcf0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:46:05.670111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:05.679366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:05.679366 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:05.693016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:46:05.694691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:05.762007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1192/2395] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:46:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:46:05.772226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:05.773868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:05.836735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ce637-8c0c-448d-960c-a5751aa52fb8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:05.842138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:05.843213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:05.843595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:05.843962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:05.853796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:05.855934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:05.866028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1204/2396] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:46:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:46:06.145528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:06.147034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:06.159650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7c640-7f2b-4f94-857d-f41a7082f262 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:06.164436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:06.165295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:06.165579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:06.165861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] PATH_INFO: `/v3/projects/d2c56114da4a4fa19e37234b3e1574c6` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:06.167817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c56114da4a4fa19e37234b3e1574c6)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:06.169741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:06.215432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c56114da4a4fa19e37234b3e1574c6', 'request_id': 'req-1fafed47-1c23-4aea-a556-7cd79729c9e6'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:06.221706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c56114da4a4fa19e37234b3e1574c6', 'request_id': 'req-1fafed47-1c23-4aea-a556-7cd79729c9e6'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:06.227100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c56114da4a4fa19e37234b3e1574c6', 'request_id': 'req-1fafed47-1c23-4aea-a556-7cd79729c9e6'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:06.240276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] The token cache is being invalidate because project d2c56114da4a4fa19e37234b3e1574c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:46:06.240581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:06.241217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1fafed47-1c23-4aea-a556-7cd79729c9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:06.242782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1193/2397] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:46:06 2021] DELETE /identity/v3/projects/d2c56114da4a4fa19e37234b3e1574c6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:46:07.382405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:07.384004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:07.464547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b9fb-2c5c-4691-9c31-44c137ecb4f7 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:07.528175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:07.528834 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:07.529121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:07.529399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:07.531368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:07.544480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:07.546071 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:07.556621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1205/2398] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:46:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:46:09.780269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:09.780826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:09.780826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:09.799497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:46:09.800718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:09.856274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1194/2399] 10.222.0.76 () {58 vars in 967 bytes} [Thu Oct 28 08:46:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:46:09.870585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:09.872019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:09.950297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf1f86-c848-4bf7-b0c2-4bd82b353610 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:09.955646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:09.956298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:09.956588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:09.956912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:09.965916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:09.968037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4369c81-abff-4b6e-99bc-6b3977d57d89 service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:09.976394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1206/2400] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:46:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:46:12.578712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:12.580143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:12.644314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0137a-ac72-4457-b85c-e2bced3e04fa None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:12.648992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:12.649859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:12.650149 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:12.650427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] PATH_INFO: `/v3/users/7d45dc24103d43f18f6bd08b283dc6b0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:12.652398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d45dc24103d43f18f6bd08b283dc6b0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:12.654238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:12.700773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d45dc24103d43f18f6bd08b283dc6b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:12.701451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d45dc24103d43f18f6bd08b283dc6b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:12.708320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d45dc24103d43f18f6bd08b283dc6b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:12.720704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d45dc24103d43f18f6bd08b283dc6b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:12.728111 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d45dc24103d43f18f6bd08b283dc6b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:12.734056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1195/2401] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:46:12 2021] DELETE /identity/v3/users/7d45dc24103d43f18f6bd08b283dc6b0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:46:12.738614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:12.739116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:12.739233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:12.755988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:46:12.757197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:12.815752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1207/2402] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:46:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:46:12.826062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:12.827533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:12.884097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfc1a8-1c71-4218-8d47-ce10e95675f5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:12.888717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:12.889371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:12.889659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:12.889998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:12.899578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:12.901702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004be1f4-ab8f-4e43-ad42-b2e66d207dc0 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:12.912204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1196/2403] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:46:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:46:13.172170 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:46:13.174045 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:46:13.186732 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876c55-9c0d-427f-b7fb-a2c7ba5c2b63 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:46:13.191561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:46:13.192465 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:46:13.192750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:46:13.193049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] PATH_INFO: `/v3/projects/e23a971ee0d64cbf893666cdbb514f7e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:46:13.194238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23a971ee0d64cbf893666cdbb514f7e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:46:13.196209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:46:13.243301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23a971ee0d64cbf893666cdbb514f7e', 'request_id': 'req-5737e82a-70f9-4b9d-85fd-b97a1011d805'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:13.249229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23a971ee0d64cbf893666cdbb514f7e', 'request_id': 'req-5737e82a-70f9-4b9d-85fd-b97a1011d805'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:13.255262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23a971ee0d64cbf893666cdbb514f7e', 'request_id': 'req-5737e82a-70f9-4b9d-85fd-b97a1011d805'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:13.268178 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] The token cache is being invalidate because project e23a971ee0d64cbf893666cdbb514f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:46:13.268466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:13.269087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:46:13.270647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1208/2404] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:46:13 2021] DELETE /identity/v3/projects/e23a971ee0d64cbf893666cdbb514f7e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:47:26.377355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf969a9-4dcc-4bab-9bf8-f87ef2b818e8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:47:26.377897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf969a9-4dcc-4bab-9bf8-f87ef2b818e8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:47:26.377897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf969a9-4dcc-4bab-9bf8-f87ef2b818e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:47:26.395815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-daf969a9-4dcc-4bab-9bf8-f87ef2b818e8 None None] MFA Rules not processed for user `a8a8c3c685aa49499037c493b1b99eed`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:47:26.397012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-daf969a9-4dcc-4bab-9bf8-f87ef2b818e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:47:26.450135 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1197/2405] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:47:26 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:48:02.868576 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:48:02.870101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:48:02.941052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737e82a-70f9-4b9d-85fd-b97a1011d805 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:48:02.946076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:48:02.946759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:48:02.947047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:48:02.947326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:48:02.949118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:48:02.960450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:48:02.962053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914800-40b2-4f14-b88c-3e47de43857b service placement] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:48:02.972772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1209/2406] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:48:02 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:48:13.674297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee07f-f3fd-4b2f-b465-0a89afbc3f70 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:48:13.674860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee07f-f3fd-4b2f-b465-0a89afbc3f70 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:48:13.674860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee07f-f3fd-4b2f-b465-0a89afbc3f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:48:13.694602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1c4ee07f-f3fd-4b2f-b465-0a89afbc3f70 None None] MFA Rules not processed for user `483af16bae1f4521ad3e3138bbc86123`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:48:13.695823 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1c4ee07f-f3fd-4b2f-b465-0a89afbc3f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:48:13.750178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1198/2407] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:48:13 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:48:38.906362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:48:38.907194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:48:38.907194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] PATH_INFO: `/` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:48:38.908909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1210/2408] 10.222.0.76 () {54 vars in 921 bytes} [Thu Oct 28 08:48:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 08:48:38.915537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b1e5-9983-4695-a2ae-e22d41fea568 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:48:38.916060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b1e5-9983-4695-a2ae-e22d41fea568 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:48:38.916283 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3b1e5-9983-4695-a2ae-e22d41fea568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:48:38.934779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0ca3b1e5-9983-4695-a2ae-e22d41fea568 None None] MFA Rules not processed for user `b2d5c942c4e64408b177014981e1e6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:48:38.935995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0ca3b1e5-9983-4695-a2ae-e22d41fea568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:48:38.989110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1199/2409] 10.222.0.76 () {58 vars in 1018 bytes} [Thu Oct 28 08:48:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:48:39.002443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:48:39.004218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:48:39.018269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b5ebf-3ea7-4eeb-8392-cc9f3a6ad89f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:48:39.021887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:48:39.022541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:48:39.022824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:48:39.023100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:48:39.030797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:48:39.032774 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:48:39.040649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1211/2410] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:48:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:49:29.193532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0b10-1270-47a4-8ebb-97dc24e39745 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:49:29.194226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0b10-1270-47a4-8ebb-97dc24e39745 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:49:29.194431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0b10-1270-47a4-8ebb-97dc24e39745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:49:29.212799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ac9b0b10-1270-47a4-8ebb-97dc24e39745 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:49:29.214323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ac9b0b10-1270-47a4-8ebb-97dc24e39745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:49:29.270422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1200/2411] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:49:29 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:49:29.320838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:49:29.322269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:49:29.394327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e49a80-3f57-48dc-9579-6ce133bc4796 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:49:29.399365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:49:29.400021 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:49:29.400304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:49:29.400580 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:49:29.409768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:49:29.411411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:49:29.419715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1212/2412] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:49:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:49:46.738265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:49:46.738849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:49:46.738849 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:49:46.758670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:49:46.759874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:49:46.768107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1201/2413] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:49:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:49:46.780967 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:49:46.792479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4175-0da7-401f-a43d-8508a38cefe8 service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:49:46.797731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:49:46.798367 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:49:46.798686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:49:46.798968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:49:46.807231 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:49:46.808821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:49:46.817274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1213/2414] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:49:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:49:53.301952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:49:53.303484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:49:53.319335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658d1d-5a1d-4443-82b0-13e2f77e8b79 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:49:53.323531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:49:53.324204 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:49:53.324486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:49:53.324767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:49:53.327098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:49:53.409055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:49:53.410550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:49:53.437875 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1202/2415] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:49:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:03.565083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:03.566713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:03.582970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61aab-24a6-491b-aba9-5aff4061874d service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:03.593000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:03.594377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:03.594688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:03.594963 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:03.597208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:03.636447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:03.638144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:03.660053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1214/2416] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:04.088745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:04.098233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932831b4-6caa-4ac2-96dd-9d3f4508babe service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:04.101999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:04.102695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:04.102985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:04.103265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:04.105502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:04.121406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:04.122908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd04a4-28dd-47cf-892e-ef9b8e190023 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:04.135386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1203/2417] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:05.496129 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:05.497762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:05.512767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38146f-c69f-42f4-8d74-8e44ef578146 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:05.519276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:05.519932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:05.520211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:05.520479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:05.523215 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:05.559472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:05.563085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:05.587381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1215/2418] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:05 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:10.556177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:10.556670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:10.556670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:10.575746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:10.576986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:10.584881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1204/2419] 10.222.0.76 () {58 vars in 967 bytes} [Thu Oct 28 08:50:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:10.599051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:10.611192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a92f4-1827-4844-a8dc-9fbf5d560e7b service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:10.616890 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:10.617552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:10.617838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:10.618119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:10.628534 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:10.630150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:10.639833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1216/2420] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:50:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 08:50:29.834732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:29.868683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e57ef-d3be-4fe8-9602-463936326c8a None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:29.883052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:29.885985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:29.886788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:29.887446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:29.891751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:29.917790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:29.922649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:29.944183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1205/2421] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:30.728807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:30.739369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b911f-12c5-4292-8be8-eabbd0b82b5b service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:30.743014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:30.743669 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:30.743954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:30.744225 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:30.746399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:30.822404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:30.823925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:30.834289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1217/2422] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:30 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:32.419335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:32.439290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ea10c-9c94-44ec-9105-20ad764c3033 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:32.444979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:32.445842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:32.446578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:32.447280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:32.450677 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:32.465708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:32.469173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:32.482208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1206/2423] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:36.137659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:36.148242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9adccc-c246-48ba-a3ae-13cde13d0158 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:36.153359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:36.154033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:36.154358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:36.154673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:36.156920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:36.236912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:36.238519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:36.249825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1218/2424] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:36.391530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:36.404171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d9cb1-e1d3-4b66-9383-4bd26c2cadd3 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:36.410793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:36.412827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:36.413303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:36.413761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:36.416877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:36.433880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:36.437022 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:36.449302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1207/2425] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:40.781121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:40.784035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:40.811392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb5aca-53de-41a0-a4de-7e807de260ba service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:40.820332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:40.821172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:40.821612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:40.821894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] PATH_INFO: `/v3/users/483af16bae1f4521ad3e3138bbc86123` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:40.823381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] RBAC: Authorizing `identity:delete_user(user_id=483af16bae1f4521ad3e3138bbc86123)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:40.825480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:40.900846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483af16bae1f4521ad3e3138bbc86123'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:40.909469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483af16bae1f4521ad3e3138bbc86123'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:40.909788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483af16bae1f4521ad3e3138bbc86123'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:40.933605 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483af16bae1f4521ad3e3138bbc86123'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:40.950554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5e39f425-5ccf-4278-a865-21772d2d47da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483af16bae1f4521ad3e3138bbc86123'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:40.965506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1219/2426] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:40 2021] DELETE /identity/v3/users/483af16bae1f4521ad3e3138bbc86123 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:41.192214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.204287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a183-c31b-4bb6-83c1-3e8559e54263 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.313963 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.315056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.315350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.315631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] PATH_INFO: `/v3/projects/d12dfed3afe746b58b897b104b2a78ae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.317065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12dfed3afe746b58b897b104b2a78ae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.319526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.381133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12dfed3afe746b58b897b104b2a78ae', 'request_id': 'req-8ff97cad-6180-4e30-93c3-509c883cf60b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:41.387901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12dfed3afe746b58b897b104b2a78ae', 'request_id': 'req-8ff97cad-6180-4e30-93c3-509c883cf60b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:41.394407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12dfed3afe746b58b897b104b2a78ae', 'request_id': 'req-8ff97cad-6180-4e30-93c3-509c883cf60b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:41.408444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] The token cache is being invalidate because project d12dfed3afe746b58b897b104b2a78ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:41.408818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:41.409451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8ff97cad-6180-4e30-93c3-509c883cf60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:41.411370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1208/2427] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:41 2021] DELETE /identity/v3/projects/d12dfed3afe746b58b897b104b2a78ae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:41.417280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.417572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.417859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.440705 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:41.442218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:41.527322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1220/2428] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:41.537306 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.537682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.538244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.559372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:41.561214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:41.571755 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1209/2429] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:41.577269 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.589835 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de474-fee1-4093-a256-f43e01f411e9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.596154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.596838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.597124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.597408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.598172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:41.598480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.600122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.616798 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1221/2430] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:50:41.621628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.632792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da551414-b30c-4f22-ba26-ecae6ba27f24 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.638235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.639720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.640003 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.640501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.641256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.643301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.702416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1210/2431] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:41 2021] POST /identity/v3/projects => generated 403 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:41.707477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.725082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780cbef-ae52-4fd7-8f9d-108ae02628ca admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.794687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.795830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.795830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.796088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.796642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.798639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.820691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1222/2432] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:41 2021] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:41.825376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.841242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5600a09-15e5-4991-81ca-9895f87295ad admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.847258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.848028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.848331 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.848712 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.850009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.851732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.865178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1211/2433] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:41.869737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.881003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ca499-0a4c-4e11-a557-e4e43ed804bf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.886110 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.886757 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.887044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.887328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.888103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.890457 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793e991-8030-40a7-abd6-0c0e09c8d686 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.901446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1223/2434] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:41.906794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:41.917637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f741f5-49c2-489d-be37-f2857a8887e5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:41.923312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:41.929659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.929659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.929659 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] PATH_INFO: `/v3/projects/ed847313b3b146339f4bdcf54a1a1e88/users/1ba6f618b4ba4c81b3af0fd64619e1de/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:41.947053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed847313b3b146339f4bdcf54a1a1e88, user_id=1ba6f618b4ba4c81b3af0fd64619e1de, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:41.952909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:41.970984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1212/2435] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:41 2021] PUT /identity/v3/projects/ed847313b3b146339f4bdcf54a1a1e88/users/1ba6f618b4ba4c81b3af0fd64619e1de/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:41.976223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853987-f154-424a-af13-bef3325ea112 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:41.976588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853987-f154-424a-af13-bef3325ea112 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:41.977086 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f853987-f154-424a-af13-bef3325ea112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:42.000000 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3f853987-f154-424a-af13-bef3325ea112 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:42.001282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3f853987-f154-424a-af13-bef3325ea112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:42.101741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1224/2436] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:42.119710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:42.121763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:42.199330 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc80d0-b87f-4dcc-8665-f346a73e4336 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:42.208815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:42.209544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:42.209954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:42.210147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:42.221585 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:42.223098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:42.234746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1213/2437] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:43.341694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.342258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.342936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.374365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] MFA Rules not processed for user `1ba6f618b4ba4c81b3af0fd64619e1de`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:43.376085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:43.459010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1225/2438] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:43 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:43.464684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.477870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b966a3-4bb0-41cf-ad10-5246403300d4 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.488261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.488950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.489237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.489520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.490239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.492269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.532431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.543253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1214/2439] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:43 2021] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:43.548904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764b55f-4138-43ff-9b7e-a86f56283260 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.622546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.623277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.624271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.624271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.624743 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.627120 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.655745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1226/2440] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:43 2021] POST /identity/v3/users => generated 308 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:43.657291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.669609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ee6c1-1d20-4045-814e-41f38a94e022 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.676745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.677546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.678617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.680591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.680591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.681991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.696853 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1215/2441] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:43 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:43.698044 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.711616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5138630-3edd-4edc-9243-815cd008604b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.718359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.719248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.719851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.720629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] PATH_INFO: `/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b/users/9a83017df883428d94fee53a559acc79/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.741943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da074abfed8b49c3b5a0a498bdb77a8b, user_id=9a83017df883428d94fee53a559acc79, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.745611 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.766359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1227/2442] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:43 2021] PUT /identity/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b/users/9a83017df883428d94fee53a559acc79/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:43.767946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.780420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0136b-adc0-414a-aeaa-640f99e32a3c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.866612 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.867639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.868053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.868436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.869308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.871173 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27826362-fe52-49c7-9a7f-b3afda57998c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.888110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1216/2443] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:43 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:43.893828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:43.905888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45009f-c292-4039-872d-680794e68e69 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:43.911073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:43.911980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:43.912260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:43.912536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] PATH_INFO: `/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b/users/9a83017df883428d94fee53a559acc79/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:43.914610 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da074abfed8b49c3b5a0a498bdb77a8b, user_id=9a83017df883428d94fee53a559acc79, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:43.917299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:43.934445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1228/2444] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:43 2021] PUT /identity/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b/users/9a83017df883428d94fee53a559acc79/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:45.172604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:45.173539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:45.174001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:45.209806 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] MFA Rules not processed for user `9a83017df883428d94fee53a559acc79`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:45.211438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:45.308274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1217/2445] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:45 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:45.773943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:45.781172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:45.849166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05873a2d-3023-414a-bc1c-94f4fd66e07b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:45.854036 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:45.854939 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:45.855223 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:45.855602 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] PATH_INFO: `/v3/users/f262d208d53949b8a1836c8aa4fc3376` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:45.857147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f262d208d53949b8a1836c8aa4fc3376)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:45.858978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:45.911758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f262d208d53949b8a1836c8aa4fc3376'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:45.912424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f262d208d53949b8a1836c8aa4fc3376'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:45.913022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f262d208d53949b8a1836c8aa4fc3376'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:45.926867 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f262d208d53949b8a1836c8aa4fc3376'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:45.939515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f262d208d53949b8a1836c8aa4fc3376'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:45.954684 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1229/2446] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:45 2021] DELETE /identity/v3/users/f262d208d53949b8a1836c8aa4fc3376 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:46.237927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:46.258685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a3c25-d607-4b28-8990-3a6980dd47ba None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:46.361490 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:46.362754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:46.363219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:46.363657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] PATH_INFO: `/v3/projects/3b5a1400e6c8401a9ac7192333826fde` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:46.365718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5a1400e6c8401a9ac7192333826fde)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:46.370672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:46.432317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5a1400e6c8401a9ac7192333826fde', 'request_id': 'req-3e3b655d-7159-40f5-9efb-56902a39ccbe'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.440329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5a1400e6c8401a9ac7192333826fde', 'request_id': 'req-3e3b655d-7159-40f5-9efb-56902a39ccbe'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.447176 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5a1400e6c8401a9ac7192333826fde', 'request_id': 'req-3e3b655d-7159-40f5-9efb-56902a39ccbe'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.467935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] The token cache is being invalidate because project 3b5a1400e6c8401a9ac7192333826fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:46.468658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.469513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.471704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1218/2447] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:46 2021] DELETE /identity/v3/projects/3b5a1400e6c8401a9ac7192333826fde => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:50:46.481660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:46.481660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:46.495424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505107a6-c8f0-41a1-8aaf-563dd6151826 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:46.557409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:46.558459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:46.558778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:46.559057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] PATH_INFO: `/v3/users/7f2dd949a95743ae9445a1e3300dfbde` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:46.560989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2dd949a95743ae9445a1e3300dfbde)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:46.563159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:46.629386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2dd949a95743ae9445a1e3300dfbde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.630429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2dd949a95743ae9445a1e3300dfbde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.631369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2dd949a95743ae9445a1e3300dfbde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.645802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2dd949a95743ae9445a1e3300dfbde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.655791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2dd949a95743ae9445a1e3300dfbde'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.671182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1230/2448] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:46 2021] DELETE /identity/v3/users/7f2dd949a95743ae9445a1e3300dfbde => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:46.719640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:46.721240 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:46.739243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b655d-7159-40f5-9efb-56902a39ccbe admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:46.806158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:46.807443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:46.807860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:46.808147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] PATH_INFO: `/v3/users/1ba6f618b4ba4c81b3af0fd64619e1de` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:46.809389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba6f618b4ba4c81b3af0fd64619e1de)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:46.811389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:46.866016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba6f618b4ba4c81b3af0fd64619e1de'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.866780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba6f618b4ba4c81b3af0fd64619e1de'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.876498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba6f618b4ba4c81b3af0fd64619e1de'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.891290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba6f618b4ba4c81b3af0fd64619e1de'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.905321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:46.907129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba6f618b4ba4c81b3af0fd64619e1de'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:46.907586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:46.917747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1219/2449] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:46 2021] DELETE /identity/v3/users/1ba6f618b4ba4c81b3af0fd64619e1de => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:50:46.930558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa63aca-a796-49ae-a6af-7986bf5e40ca admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:46.992859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:46.993737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:46.994016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:46.994314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] PATH_INFO: `/v3/projects/0071d1b0afe94143ad5ba7328569708e` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:46.995625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0071d1b0afe94143ad5ba7328569708e)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:46.997588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:47.048487 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0071d1b0afe94143ad5ba7328569708e', 'request_id': 'req-66c1e48d-0375-40c9-9b9d-7023018adfb8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.054511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0071d1b0afe94143ad5ba7328569708e', 'request_id': 'req-66c1e48d-0375-40c9-9b9d-7023018adfb8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.061018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0071d1b0afe94143ad5ba7328569708e', 'request_id': 'req-66c1e48d-0375-40c9-9b9d-7023018adfb8'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.074567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] The token cache is being invalidate because project 0071d1b0afe94143ad5ba7328569708e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:47.074863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.076164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.081894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1231/2450] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:46 2021] DELETE /identity/v3/projects/0071d1b0afe94143ad5ba7328569708e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:47.113405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:47.114994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:47.140358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909756d-c0d4-482c-a58b-2aae5d096333 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:47.220711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:47.221780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:47.222082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:47.222354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] PATH_INFO: `/v3/projects/ed847313b3b146339f4bdcf54a1a1e88` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:47.224122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed847313b3b146339f4bdcf54a1a1e88)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:47.226239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:47.286274 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed847313b3b146339f4bdcf54a1a1e88', 'request_id': 'req-55c95e3b-0664-4a9e-ae26-096ad0b55c45'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.293789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed847313b3b146339f4bdcf54a1a1e88', 'request_id': 'req-55c95e3b-0664-4a9e-ae26-096ad0b55c45'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.300496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed847313b3b146339f4bdcf54a1a1e88', 'request_id': 'req-55c95e3b-0664-4a9e-ae26-096ad0b55c45'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.321441 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] The token cache is being invalidate because project ed847313b3b146339f4bdcf54a1a1e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:47.321955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.322672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.324339 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1220/2451] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:47 2021] DELETE /identity/v3/projects/ed847313b3b146339f4bdcf54a1a1e88 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:50:47.330150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:47.332483 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:47.355097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e48d-0375-40c9-9b9d-7023018adfb8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:47.417922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:47.419237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:47.419694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:47.420216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] PATH_INFO: `/v3/users/9a83017df883428d94fee53a559acc79` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:47.422186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a83017df883428d94fee53a559acc79)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:47.425464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:47.481046 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a83017df883428d94fee53a559acc79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.481824 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a83017df883428d94fee53a559acc79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.482450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a83017df883428d94fee53a559acc79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.494256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a83017df883428d94fee53a559acc79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.503971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3f786876-75d2-47c3-b4c0-436101098cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a83017df883428d94fee53a559acc79'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.517546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1232/2452] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:47 2021] DELETE /identity/v3/users/9a83017df883428d94fee53a559acc79 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:47.691912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:47.693344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:47.706388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95e3b-0664-4a9e-ae26-096ad0b55c45 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:47.771398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:47.772273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:47.772638 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:47.773375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] PATH_INFO: `/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:47.774144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da074abfed8b49c3b5a0a498bdb77a8b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:47.776103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:47.831518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da074abfed8b49c3b5a0a498bdb77a8b', 'request_id': 'req-610e3de8-24d0-467f-b438-eefaddd2f536'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.837956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da074abfed8b49c3b5a0a498bdb77a8b', 'request_id': 'req-610e3de8-24d0-467f-b438-eefaddd2f536'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.843824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da074abfed8b49c3b5a0a498bdb77a8b', 'request_id': 'req-610e3de8-24d0-467f-b438-eefaddd2f536'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.863793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] The token cache is being invalidate because project da074abfed8b49c3b5a0a498bdb77a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:47.864079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.864741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-610e3de8-24d0-467f-b438-eefaddd2f536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:47.866488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1221/2453] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:47 2021] DELETE /identity/v3/projects/da074abfed8b49c3b5a0a498bdb77a8b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:47.872357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea99d-532b-4465-8760-629898a628fe None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:47.873366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea99d-532b-4465-8760-629898a628fe None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:47.873661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaea99d-532b-4465-8760-629898a628fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:47.892308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cbaea99d-532b-4465-8760-629898a628fe None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:47.893564 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cbaea99d-532b-4465-8760-629898a628fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:47.956713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1233/2454] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:47.964814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:47.965101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:47.965376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:47.985381 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:47.986971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:47.995998 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1222/2455] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:48.000805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea99d-532b-4465-8760-629898a628fe None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.011144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaea99d-532b-4465-8760-629898a628fe None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.015911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.016828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.016989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.017238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.017989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:48.018296 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.020256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.033118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1234/2456] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:50:48.037551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.047499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84093ed-6bd0-4335-8e69-45b5aa70c1fa None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.052321 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.052974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.053261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.053892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.054629 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.056569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.086560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1223/2457] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:48.087872 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.099304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d179a-11a1-490d-8d4a-9cfe0bd07edd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.155739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.156411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.156698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.156978 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.157692 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.159663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.180222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1235/2458] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:48.184504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.195346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667ac3-ff8d-4e4e-9d25-4de89b4a36d7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.201586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.202160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.202446 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.202799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.203496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.205134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.217590 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1224/2459] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:48.221485 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.231466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18a247-f23f-4178-a9f1-64205c4fbde9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.237563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.238232 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.238536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.238818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.239572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.241188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7300e68-00f2-4894-94f5-83951326592c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.251922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1236/2460] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:48.256113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.266780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16746b1-85d3-44f0-a455-401c3589b7bf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.271606 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.272481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.272764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.273040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] PATH_INFO: `/v3/projects/f7c220955a8c497b9176e46aef8d6757/users/3ce6692c3f8647edb4ea91350841cd69/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.288701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c220955a8c497b9176e46aef8d6757, user_id=3ce6692c3f8647edb4ea91350841cd69, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.291429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.305501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1225/2461] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:48 2021] PUT /identity/v3/projects/f7c220955a8c497b9176e46aef8d6757/users/3ce6692c3f8647edb4ea91350841cd69/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:48.317373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2255b-7913-439b-812c-e69472025005 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.317663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2255b-7913-439b-812c-e69472025005 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.317938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2255b-7913-439b-812c-e69472025005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.346635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c5a2255b-7913-439b-812c-e69472025005 None None] MFA Rules not processed for user `3ce6692c3f8647edb4ea91350841cd69`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:48.347878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c5a2255b-7913-439b-812c-e69472025005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:48.412645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1237/2462] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:48.417357 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.481466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a1a0-ffa2-4d57-ae09-538fac99d11e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.486726 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.487423 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.487706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.488011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.488739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.490683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.516595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1226/2463] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:48.521259 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2255b-7913-439b-812c-e69472025005 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.532973 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2255b-7913-439b-812c-e69472025005 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.590515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.591940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.592082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.592366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.593079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.595171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.616683 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1238/2464] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:48.621168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.632359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5906ad-3682-4a7c-942c-83fc79fd9c49 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.637284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.637970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.638915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.639184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.639961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.641799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.652925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1227/2465] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:48.657993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.668184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e47c81-14bb-4bb0-b47e-be9c38bed378 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.673326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.674209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.674490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.674795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] PATH_INFO: `/v3/projects/0004133e75d947158a54e805527413f4/users/e44f01a1e81b43c0b2c787eb1c275d13/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.690760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0004133e75d947158a54e805527413f4, user_id=e44f01a1e81b43c0b2c787eb1c275d13, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.693566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.708558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1239/2466] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:48 2021] PUT /identity/v3/projects/0004133e75d947158a54e805527413f4/users/e44f01a1e81b43c0b2c787eb1c275d13/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:48.712872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.723192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f1023-3470-4c35-8f03-6edba07dc148 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.780774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.781404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.781693 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.781973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.782774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.784375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a967f-d85a-4b7e-9313-80b8628d0df5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.794668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1228/2467] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:48.799356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:48.810380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728ab4-50a5-4bb8-a1bb-c9bf0c6bb547 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:48.815861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:48.816737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.817022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.817428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] PATH_INFO: `/v3/projects/0004133e75d947158a54e805527413f4/users/e44f01a1e81b43c0b2c787eb1c275d13/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.819558 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0004133e75d947158a54e805527413f4, user_id=e44f01a1e81b43c0b2c787eb1c275d13, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:48.822225 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:48.834395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1240/2468] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:48 2021] PUT /identity/v3/projects/0004133e75d947158a54e805527413f4/users/e44f01a1e81b43c0b2c787eb1c275d13/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:48.845157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711316-6501-472c-b340-a92474b0d4e7 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:48.845451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711316-6501-472c-b340-a92474b0d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:48.845736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39711316-6501-472c-b340-a92474b0d4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:48.874902 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-39711316-6501-472c-b340-a92474b0d4e7 None None] MFA Rules not processed for user `e44f01a1e81b43c0b2c787eb1c275d13`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:48.876142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-39711316-6501-472c-b340-a92474b0d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:48.957460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1229/2469] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:48 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:48.963571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:49.026907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4619a-3817-4bbc-b9aa-c2e84d16fa74 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:49.031954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:49.032768 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:49.033058 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:49.033345 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] PATH_INFO: `/v3/users/3ce6692c3f8647edb4ea91350841cd69` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:49.034636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce6692c3f8647edb4ea91350841cd69)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:49.036608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:49.087868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce6692c3f8647edb4ea91350841cd69'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.088526 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce6692c3f8647edb4ea91350841cd69'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.089239 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce6692c3f8647edb4ea91350841cd69'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.101660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce6692c3f8647edb4ea91350841cd69'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.110133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce6692c3f8647edb4ea91350841cd69'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.123322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1241/2470] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:48 2021] DELETE /identity/v3/users/3ce6692c3f8647edb4ea91350841cd69 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:49.128114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:49.128436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:49.128715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:49.146533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:49.147735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:49.209033 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1230/2471] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:49.220198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:49.221629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:49.280327 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd1ea-0bcd-4686-95a0-4c0bfb2133fd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:49.284815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:49.285394 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:49.285678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:49.285951 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:49.296749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:49.298281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:49.308315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1242/2472] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:49.596419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:49.599016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:49.615138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99a876-a6a6-47f3-bb24-60335fb306ff None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:49.622524 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:49.624368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:49.625081 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:49.626032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] PATH_INFO: `/v3/projects/f7c220955a8c497b9176e46aef8d6757` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:49.627589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c220955a8c497b9176e46aef8d6757)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:49.629546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:49.682174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c220955a8c497b9176e46aef8d6757', 'request_id': 'req-68f90f40-b95a-4be9-b787-63f85005e002'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.688872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c220955a8c497b9176e46aef8d6757', 'request_id': 'req-68f90f40-b95a-4be9-b787-63f85005e002'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.695342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c220955a8c497b9176e46aef8d6757', 'request_id': 'req-68f90f40-b95a-4be9-b787-63f85005e002'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.709040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] The token cache is being invalidate because project f7c220955a8c497b9176e46aef8d6757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:49.709325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.709957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.711817 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1231/2473] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:49 2021] DELETE /identity/v3/projects/f7c220955a8c497b9176e46aef8d6757 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:49.715965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:49.728074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53ed7-d8bf-408b-8cab-34bee52a7907 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:49.788079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:49.788870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:49.789158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:49.789437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] PATH_INFO: `/v3/users/e44f01a1e81b43c0b2c787eb1c275d13` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:49.790720 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44f01a1e81b43c0b2c787eb1c275d13)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:49.792723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:49.840121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44f01a1e81b43c0b2c787eb1c275d13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.840777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44f01a1e81b43c0b2c787eb1c275d13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.841999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44f01a1e81b43c0b2c787eb1c275d13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.853671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44f01a1e81b43c0b2c787eb1c275d13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.861830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1728bc94-1f8d-4741-8b88-26b8987fe4af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44f01a1e81b43c0b2c787eb1c275d13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:49.876893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1243/2474] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:49 2021] DELETE /identity/v3/users/e44f01a1e81b43c0b2c787eb1c275d13 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:50.175669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.177358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:50.192217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90f40-b95a-4be9-b787-63f85005e002 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.267107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.268273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.268682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.268966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] PATH_INFO: `/v3/projects/0004133e75d947158a54e805527413f4` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.270294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0004133e75d947158a54e805527413f4)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.272262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.322241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0004133e75d947158a54e805527413f4', 'request_id': 'req-00305746-4ac7-4877-9700-a25ca76ee206'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:50.328513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0004133e75d947158a54e805527413f4', 'request_id': 'req-00305746-4ac7-4877-9700-a25ca76ee206'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:50.334279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0004133e75d947158a54e805527413f4', 'request_id': 'req-00305746-4ac7-4877-9700-a25ca76ee206'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:50.348747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] The token cache is being invalidate because project 0004133e75d947158a54e805527413f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:50.349065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:50.349798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-00305746-4ac7-4877-9700-a25ca76ee206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:50.351427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1232/2475] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:50 2021] DELETE /identity/v3/projects/0004133e75d947158a54e805527413f4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:50.358117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.358787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.358787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.377819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:50.379214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:50.444344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1244/2476] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:50.452130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.452418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.452699 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.473768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:50.475648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:50.488127 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1233/2477] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:50:50.492536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.502600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d343688-d3a1-4bdf-afce-b5bda258a1f3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.507293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.507954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.508245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.508524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.509274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:50.509578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.511250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.524002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1245/2478] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:50:50.529774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.539689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c321e-4024-46a0-b903-98f7bf8935fd None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.544896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.545581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.545864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.546146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.546956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.548898 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.579378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1234/2479] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:50.581856 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.593075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c2d00-433f-40c7-b415-3cc08d4f034f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.657656 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.658330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.658662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.658947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.659671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.661603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.683562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1246/2480] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:50.687769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.698695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff1ab5-2c6b-4698-8a13-fa35187f3c6e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.704314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.704988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.705294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.705575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.706323 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.708005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.719631 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1235/2481] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:50.724330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.734622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459af70d-1bf1-481c-8187-12fe412b19e1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.739328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.739980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.740260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.740535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.741280 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.743383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bee0ca-7891-4c70-a65d-01871c03e2b2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.754065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1247/2482] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:50.758410 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.769559 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10355004-9788-4ee7-9b5c-456dc6946f38 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.775089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.775972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.776255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.776533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] PATH_INFO: `/v3/projects/266f6e83c1314f558a534e503f6d030a/users/2114496d4fa14002a19773e3b06bf9cf/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.792073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=266f6e83c1314f558a534e503f6d030a, user_id=2114496d4fa14002a19773e3b06bf9cf, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.794905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:50.808302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1236/2483] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:50 2021] PUT /identity/v3/projects/266f6e83c1314f558a534e503f6d030a/users/2114496d4fa14002a19773e3b06bf9cf/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:50.819698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.819999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.820286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.848459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] MFA Rules not processed for user `2114496d4fa14002a19773e3b06bf9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:50.849579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:50.918143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1248/2484] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:50.923994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:50.986879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118fa51-de37-4205-93d6-7c765d561b6c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:50.992598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:50.993143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:50.993437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:50.993697 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:50.994412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:50.996342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.023352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1237/2485] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:50 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:51.027496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.039310 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01791-40e5-4317-bba2-aabe6084c7dc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.098696 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.100969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.100969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.100969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.100969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.102429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.128096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1249/2486] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:51 2021] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:51.132049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.143600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7644e3-45ac-444d-932b-a1f70ac1ace8 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.149046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.149724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.150015 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.150296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.151100 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.152719 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.164555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1238/2487] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:51.169019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.180391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969348f2-9969-49a3-98b4-553b0341b2e9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.187676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.188595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.188911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.189193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] PATH_INFO: `/v3/projects/d66682a0ac54484fa339a7dfdf3ce207/users/bcef3baa37f544ed9c11f8c681846595/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.206374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66682a0ac54484fa339a7dfdf3ce207, user_id=bcef3baa37f544ed9c11f8c681846595, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.209600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.224286 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1250/2488] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:51 2021] PUT /identity/v3/projects/d66682a0ac54484fa339a7dfdf3ce207/users/bcef3baa37f544ed9c11f8c681846595/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:51.228289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.239334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17569e-88a6-44d4-9369-38563cad5722 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.299243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.299919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.300205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.300478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.301218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.302864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d528969-251d-4d18-9350-ee3a8c5e1351 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.313256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1239/2489] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:51 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:51.317490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.329573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9c6c7-df40-410c-8b26-c7688d7a70bd admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.335079 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.336234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.336517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.336793 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] PATH_INFO: `/v3/projects/d66682a0ac54484fa339a7dfdf3ce207/users/bcef3baa37f544ed9c11f8c681846595/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.338878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66682a0ac54484fa339a7dfdf3ce207, user_id=bcef3baa37f544ed9c11f8c681846595, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.342329 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.354704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1251/2490] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:51 2021] PUT /identity/v3/projects/d66682a0ac54484fa339a7dfdf3ce207/users/bcef3baa37f544ed9c11f8c681846595/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:51.366131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.366428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.366870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.395675 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] MFA Rules not processed for user `bcef3baa37f544ed9c11f8c681846595`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:51.396917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:51.465117 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1240/2491] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:51 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:51.476561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.478309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:51.545606 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd109dd8-2bca-4420-9a99-9b66ed1d866d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.549364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.550015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.550687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.550687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.560017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.561498 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbfbb5-583f-4681-8b03-d4f2ba82c776 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.571185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1252/2492] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:51 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:51.635851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.700002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042fe14-209b-4816-a683-d836c57f0231 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.705877 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.706831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.707118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.707406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] PATH_INFO: `/v3/users/2114496d4fa14002a19773e3b06bf9cf` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.708648 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2114496d4fa14002a19773e3b06bf9cf)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.711384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.772561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2114496d4fa14002a19773e3b06bf9cf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:51.773292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2114496d4fa14002a19773e3b06bf9cf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:51.780651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2114496d4fa14002a19773e3b06bf9cf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:51.791868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2114496d4fa14002a19773e3b06bf9cf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:51.800008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2114496d4fa14002a19773e3b06bf9cf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:51.806011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1241/2493] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:51 2021] DELETE /identity/v3/users/2114496d4fa14002a19773e3b06bf9cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:51.811244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.811538 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.811821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.830167 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:51.831434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:51.892522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1253/2494] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:51.902647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:51.904267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:51.960589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4266149-9a8e-438e-ac0a-624989346b58 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:51.964619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:51.965272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:51.965550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:51.965824 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:51.975571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:51.977048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:51.986637 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1242/2495] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:52.513023 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:52.514544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:52.528212 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26b323-8792-49af-8903-ea0a169f86a8 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:52.534295 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:52.535254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:52.535529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:52.535802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] PATH_INFO: `/v3/projects/266f6e83c1314f558a534e503f6d030a` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:52.537016 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266f6e83c1314f558a534e503f6d030a)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:52.538969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:52.596216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266f6e83c1314f558a534e503f6d030a', 'request_id': 'req-1cd49e35-4b74-427d-8a44-0a2e9624e661'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.602523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266f6e83c1314f558a534e503f6d030a', 'request_id': 'req-1cd49e35-4b74-427d-8a44-0a2e9624e661'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.609716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266f6e83c1314f558a534e503f6d030a', 'request_id': 'req-1cd49e35-4b74-427d-8a44-0a2e9624e661'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.624274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] The token cache is being invalidate because project 266f6e83c1314f558a534e503f6d030a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:52.624712 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.625469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.627379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1254/2496] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:52 2021] DELETE /identity/v3/projects/266f6e83c1314f558a534e503f6d030a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:52.631564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:52.641513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189c37-e25d-4b11-a81b-41015868e48d service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:52.709914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:52.711091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:52.711352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:52.711626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] PATH_INFO: `/v3/users/bcef3baa37f544ed9c11f8c681846595` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:52.712869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcef3baa37f544ed9c11f8c681846595)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:52.714850 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:52.766175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcef3baa37f544ed9c11f8c681846595'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.766852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcef3baa37f544ed9c11f8c681846595'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.775568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcef3baa37f544ed9c11f8c681846595'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.787605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcef3baa37f544ed9c11f8c681846595'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.799691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-664b3142-8fce-4597-b72f-e0b05f07fc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcef3baa37f544ed9c11f8c681846595'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:52.806445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1243/2497] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:52 2021] DELETE /identity/v3/users/bcef3baa37f544ed9c11f8c681846595 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:53.093186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.094745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:53.110137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd49e35-4b74-427d-8a44-0a2e9624e661 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.171404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.172214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.172516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.172796 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] PATH_INFO: `/v3/projects/d66682a0ac54484fa339a7dfdf3ce207` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.174010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66682a0ac54484fa339a7dfdf3ce207)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.175990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.229515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66682a0ac54484fa339a7dfdf3ce207', 'request_id': 'req-08cff7f3-f36b-461d-ab24-e12aae69d48b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:53.235618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66682a0ac54484fa339a7dfdf3ce207', 'request_id': 'req-08cff7f3-f36b-461d-ab24-e12aae69d48b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:53.241977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66682a0ac54484fa339a7dfdf3ce207', 'request_id': 'req-08cff7f3-f36b-461d-ab24-e12aae69d48b'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:53.255822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] The token cache is being invalidate because project d66682a0ac54484fa339a7dfdf3ce207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:53.256113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:53.256751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-08cff7f3-f36b-461d-ab24-e12aae69d48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:53.258314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1255/2498] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:53 2021] DELETE /identity/v3/projects/d66682a0ac54484fa339a7dfdf3ce207 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:53.264636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.264922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.265199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.283803 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:53.285044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:53.346553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1244/2499] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:53.354352 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.354738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.355029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.374111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:53.375539 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:53.383756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1256/2500] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:53.388139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.398473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7fb2e-480b-445f-b505-46dededc593b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.403286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.404456 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.404742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.405013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.405754 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:53.406058 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.407701 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.419192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1245/2501] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:50:53.424339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.433563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b342-6ccb-4c2d-b92e-086e67b12228 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.438389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.439080 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.439365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.439365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.440344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.442301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.468912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1257/2502] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:53.473402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.487217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209588c-ee91-46d3-999f-3296f3f2627b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.550888 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.551601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.551922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.552293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.553049 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.555056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.577903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1246/2503] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:53.582650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.595200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f18ed-ec8a-4943-bd4f-3a2c708aa925 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.600348 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.601035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.601318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.601595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.602349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.604025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.617448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1258/2504] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:53 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:53.623668 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.634114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2486f-4356-40bc-8ddf-cfeac283c758 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.639380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.640074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.640379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.640650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.641399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.643041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604ba76-e920-43be-9922-d99411bb8843 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.654592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1247/2505] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:50:53.659991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.670947 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99179c41-8c96-4dec-adf2-7bcc697c0748 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.675863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.676686 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.676969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.677254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] PATH_INFO: `/v3/projects/38ec3a656377497facd8bdffc7e576c7/users/e2ea08a687354d3a9a5d53090c317a4c/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.692799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ec3a656377497facd8bdffc7e576c7, user_id=e2ea08a687354d3a9a5d53090c317a4c, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.695511 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.709633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1259/2506] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:53 2021] PUT /identity/v3/projects/38ec3a656377497facd8bdffc7e576c7/users/e2ea08a687354d3a9a5d53090c317a4c/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:53.722532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.723239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.723239 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.754236 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] MFA Rules not processed for user `e2ea08a687354d3a9a5d53090c317a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:53.755532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:53.820261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1248/2507] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:53.824754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.898802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fa43-8010-473d-86b1-b5a7ea1f98aa admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:53.905427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:53.906121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:53.906402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:53.906776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:53.908742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:53.911565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:53.950441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1260/2508] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:53.955683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:53.972174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e286ab8-4383-415b-8606-49c0a79a183e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.030401 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.031107 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.031400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.031676 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.032383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.034305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.058579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1249/2509] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:53 2021] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:54.060804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.071985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93647-694e-44ac-972a-03178bb244bf admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.077507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.078358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.078638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.078975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.079662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.081293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.095125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1261/2510] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:54 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:54.100237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.112413 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a9799-cc7f-49b4-8557-4cc1ef1cc9ab admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.118696 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.120291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.120540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.120988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] PATH_INFO: `/v3/projects/d24c53db49c0431dbb7a76308c01215d/users/e4874d5f8e7d4f3da37f65468b5732a0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.139578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24c53db49c0431dbb7a76308c01215d, user_id=e4874d5f8e7d4f3da37f65468b5732a0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.142254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.159155 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1250/2511] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:54 2021] PUT /identity/v3/projects/d24c53db49c0431dbb7a76308c01215d/users/e4874d5f8e7d4f3da37f65468b5732a0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:54.163715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.179153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0a38-d97e-48e0-90f9-dbc55b793609 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.242553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.243100 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.243379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.243661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.244407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.246020 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245503b-9963-4d6c-ac63-ac2e47fdd634 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.259317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1262/2512] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:54 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:54.262671 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.274951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdf5c2-dd9e-40f3-af99-3c32d8c377db admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.280663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.281662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.281955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.282234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] PATH_INFO: `/v3/projects/d24c53db49c0431dbb7a76308c01215d/users/e4874d5f8e7d4f3da37f65468b5732a0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.284312 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24c53db49c0431dbb7a76308c01215d, user_id=e4874d5f8e7d4f3da37f65468b5732a0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.287010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.298457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1251/2513] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:54 2021] PUT /identity/v3/projects/d24c53db49c0431dbb7a76308c01215d/users/e4874d5f8e7d4f3da37f65468b5732a0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:54.309736 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.314530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.314530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.343479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] MFA Rules not processed for user `e4874d5f8e7d4f3da37f65468b5732a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:54.344873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:54.428321 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1263/2514] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:54 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:54.440536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.442770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:54.508393 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89deb6b-d9a4-4f9b-8bc6-866287d5eae7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.512157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.513398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.513845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.514131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.525972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.527231 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.544762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1252/2515] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:54 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:54.876962 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.888135 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2082a1-fb1b-4199-a8a7-cb410e64b8b5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.893039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4874d5f8e7d4f3da37f65468b5732a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd24c53db49c0431dbb7a76308c01215d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.893791 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.894158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.894566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.895326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:54.895650 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.897277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.911294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1264/2516] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:50:54.915492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.925556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c1ba-6e8e-46a7-86e8-b6573fefaeb3 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:54.930221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4874d5f8e7d4f3da37f65468b5732a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd24c53db49c0431dbb7a76308c01215d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:54.930922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:54.931215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:54.931500 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:54.932215 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:54.934132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:54.961080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1253/2517] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:54 2021] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:54.965252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:54.975795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa858132-893b-4f53-9922-69dcc53fceac tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:55.034332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4874d5f8e7d4f3da37f65468b5732a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd24c53db49c0431dbb7a76308c01215d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:55.035076 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:55.035370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:55.035663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:55.036422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:55.036741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:55.038370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:55.050322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1265/2518] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:50:55.089892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:55.101124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcafb8-fe86-4537-9a1d-a33072550685 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:55.106281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4874d5f8e7d4f3da37f65468b5732a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd24c53db49c0431dbb7a76308c01215d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:55.107548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:55.107840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:55.108125 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] PATH_INFO: `/v3/projects/d2bbffa5c0f34b3eb432d81a4bcab533` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:55.109348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2bbffa5c0f34b3eb432d81a4bcab533)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:55.111488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:55.168337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bbffa5c0f34b3eb432d81a4bcab533', 'request_id': 'req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.176567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bbffa5c0f34b3eb432d81a4bcab533', 'request_id': 'req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.183575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bbffa5c0f34b3eb432d81a4bcab533', 'request_id': 'req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.198264 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] The token cache is being invalidate because project d2bbffa5c0f34b3eb432d81a4bcab533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:55.198738 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.199506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2b420ff0-3c9a-4849-8ce7-0dc7f1e7385b tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.201893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1254/2519] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:55 2021] DELETE /identity/v3/projects/d2bbffa5c0f34b3eb432d81a4bcab533 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:55.407541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:55.408880 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:55.478735 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7ba3-c0e1-4274-a8ac-797652d968c4 tempest-VolumeQuotaClassesTest-497330738 tempest-VolumeQuotaClassesTest-497330738-project-admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:55.549406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:55.550317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:55.550624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:55.550918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] PATH_INFO: `/v3/users/e2ea08a687354d3a9a5d53090c317a4c` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:55.552150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ea08a687354d3a9a5d53090c317a4c)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:55.554088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:55.609229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ea08a687354d3a9a5d53090c317a4c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.609920 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ea08a687354d3a9a5d53090c317a4c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.610579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ea08a687354d3a9a5d53090c317a4c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.625604 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ea08a687354d3a9a5d53090c317a4c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.633919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ea08a687354d3a9a5d53090c317a4c'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:55.650194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1266/2520] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:55 2021] DELETE /identity/v3/users/e2ea08a687354d3a9a5d53090c317a4c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:55.655473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:55.655815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:55.656199 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:55.676064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:55.677301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:55.751006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1255/2521] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:55.761844 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:55.764725 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:55.830513 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87db22-0f45-44fa-b88e-ba342ae01ba1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:55.834563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:55.834999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:55.835285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:55.835700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:55.846126 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:55.847619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:55.858804 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1267/2522] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:56.151350 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:56.152867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:56.165872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4094-bcdb-4e15-aae3-d98ab68cbbc0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:56.172517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:56.173422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:56.173703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:56.173978 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] PATH_INFO: `/v3/projects/38ec3a656377497facd8bdffc7e576c7` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:56.175247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ec3a656377497facd8bdffc7e576c7)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:56.177206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:56.235056 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ec3a656377497facd8bdffc7e576c7', 'request_id': 'req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.241417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ec3a656377497facd8bdffc7e576c7', 'request_id': 'req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.246879 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ec3a656377497facd8bdffc7e576c7', 'request_id': 'req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.260505 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] The token cache is being invalidate because project 38ec3a656377497facd8bdffc7e576c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:56.260798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.261417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.263670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1256/2523] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:56 2021] DELETE /identity/v3/projects/38ec3a656377497facd8bdffc7e576c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:56.268347 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:56.278228 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd3f5f-3a1d-4b36-ba79-d62d6a13fd09 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:56.340897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:56.341803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:56.342085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:56.342382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] PATH_INFO: `/v3/users/e4874d5f8e7d4f3da37f65468b5732a0` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:56.343641 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4874d5f8e7d4f3da37f65468b5732a0)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:56.345573 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:56.394188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4874d5f8e7d4f3da37f65468b5732a0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.394771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4874d5f8e7d4f3da37f65468b5732a0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.395382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4874d5f8e7d4f3da37f65468b5732a0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.407213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4874d5f8e7d4f3da37f65468b5732a0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.414537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7966db74-5123-4e92-8626-eef35592b14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4874d5f8e7d4f3da37f65468b5732a0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:56.427056 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1268/2524] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:50:56 2021] DELETE /identity/v3/users/e4874d5f8e7d4f3da37f65468b5732a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:56.985051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:56.987349 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:57.002467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d68d19-9a3f-4abb-a928-d6a99a3e130c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.071341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.072260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.072537 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.072812 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] PATH_INFO: `/v3/projects/d24c53db49c0431dbb7a76308c01215d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.074164 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24c53db49c0431dbb7a76308c01215d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.077203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.131290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24c53db49c0431dbb7a76308c01215d', 'request_id': 'req-e0760579-2128-4055-8a86-c10a533b26c1'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:57.137352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24c53db49c0431dbb7a76308c01215d', 'request_id': 'req-e0760579-2128-4055-8a86-c10a533b26c1'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:57.143945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24c53db49c0431dbb7a76308c01215d', 'request_id': 'req-e0760579-2128-4055-8a86-c10a533b26c1'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:57.157841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] The token cache is being invalidate because project d24c53db49c0431dbb7a76308c01215d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:50:57.158517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:57.158855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e0760579-2128-4055-8a86-c10a533b26c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:50:57.160781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1257/2525] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:50:56 2021] DELETE /identity/v3/projects/d24c53db49c0431dbb7a76308c01215d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:57.166535 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.166836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.167116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.186655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:57.187889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:57.256271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1269/2526] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:57.266075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.266266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.266578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.284767 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:57.285966 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:57.294866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1258/2527] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:57.299682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.309402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db5520-f12d-4596-a500-bcf5906ebb4a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.315317 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.315969 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.316255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.316531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.317271 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:50:57.317572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.319213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.331822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1270/2528] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:50:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:50:57.338166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.347501 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa504366-a1b2-4edb-a6a0-53993f9661d5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.352399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.353057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.353578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.353864 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.354609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.357064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.383288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1259/2529] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:57.387445 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.397677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773187b3-5d7a-4b49-ae92-14cc91bcc4f9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.456216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.456954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.457241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.457521 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.458263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.460314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.484247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1271/2530] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:57.489034 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.500242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661d919-d282-4ea8-b97a-77058ffe2d26 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.505075 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.505768 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.506053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.506333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.507113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.508751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.519484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1260/2531] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:57.525292 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.536174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5658b-18d0-49b6-b134-4b1c0bcfbd55 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.541074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.541742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.542030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.542311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.543105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.545529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9ee23-58b7-4a42-818a-60da25a105d2 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.556579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1272/2532] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:57.561407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.571558 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2df5a-9f6e-48ef-8d27-087cfb9c9724 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.576689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.577575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.577856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.578132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] PATH_INFO: `/v3/projects/6bd0c576f39d40fda88c2667250f4273/users/f508d5513a724701ad11cbb6c1bb8bc6/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.593813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd0c576f39d40fda88c2667250f4273, user_id=f508d5513a724701ad11cbb6c1bb8bc6, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.596523 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.609846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1261/2533] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:57 2021] PUT /identity/v3/projects/6bd0c576f39d40fda88c2667250f4273/users/f508d5513a724701ad11cbb6c1bb8bc6/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:57.620578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.620869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.621148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.649265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] MFA Rules not processed for user `f508d5513a724701ad11cbb6c1bb8bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:57.650468 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:57.720943 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1273/2534] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:50:57.725551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.798987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c4b83-140e-4d43-b02f-0a0290d6ab67 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.813458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.814208 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.814518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.814798 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.815531 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.817449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.850346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1262/2535] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:50:57.854912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.866823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9d2d-4cca-49be-9cca-493511d5cdf5 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.927636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.928318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.928619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.928894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.929600 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.931567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.952741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1274/2536] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:50:57 2021] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:50:57.957521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:57.969448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca6b1b-a203-4a92-b704-917bab054594 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:57.974467 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:57.975171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:57.975458 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:57.975739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:57.976486 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:57.978122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:57.991325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1263/2537] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:57.995298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:58.006380 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c1129-fda8-4707-9983-f1bf08dcde5d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:58.011404 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:58.012293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.012579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.013383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] PATH_INFO: `/v3/projects/b36c2e41352b408883055663599cd4d0/users/8ba654025bb64505ab4cf6da139dd746/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.029446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36c2e41352b408883055663599cd4d0, user_id=8ba654025bb64505ab4cf6da139dd746, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:58.032287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:58.046244 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1275/2538] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:57 2021] PUT /identity/v3/projects/b36c2e41352b408883055663599cd4d0/users/8ba654025bb64505ab4cf6da139dd746/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:58.050308 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:58.060863 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167bf1-00a2-49d8-84db-b6bbac5d9edd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:58.119645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:58.120313 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.120594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.120871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.121605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:58.123716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffffeb-b534-4db0-a755-471b1c82b212 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:58.133177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1264/2539] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:50:58 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:50:58.137469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:58.150523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1507a-f355-4713-a18e-8b8d2be89666 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:58.156006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:58.156887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.157176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.157454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] PATH_INFO: `/v3/projects/b36c2e41352b408883055663599cd4d0/users/8ba654025bb64505ab4cf6da139dd746/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.160095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36c2e41352b408883055663599cd4d0, user_id=8ba654025bb64505ab4cf6da139dd746, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:58.162788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:58.173562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1276/2540] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:50:58 2021] PUT /identity/v3/projects/b36c2e41352b408883055663599cd4d0/users/8ba654025bb64505ab4cf6da139dd746/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:50:58.184214 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.185318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.185318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.213217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] MFA Rules not processed for user `8ba654025bb64505ab4cf6da139dd746`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:50:58.214437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:58.282737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1265/2541] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:50:58 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:50:58.293326 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:58.296026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:50:58.353250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16611359-6668-4571-9b46-eb44baf2231a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:58.357002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:58.357645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.357946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.358221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.367382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:58.368836 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:58.378174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1277/2542] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:58 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:50:58.518721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:50:58.528557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736709d-48c5-4f6b-88d9-75ffcb9f7455 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:50:58.532205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:50:58.532857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:50:58.533146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:50:58.533424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:50:58.590368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:50:58.592794 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171735b-34d6-43c3-83bb-53334a744a31 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:50:58.601601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1266/2543] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:50:58 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:07.941956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:08.025260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e14d3-e82e-4a60-830c-1ecce0e662be service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:08.033111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:08.034727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:08.035139 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:08.035633 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] PATH_INFO: `/v3/users/f508d5513a724701ad11cbb6c1bb8bc6` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:08.037677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f508d5513a724701ad11cbb6c1bb8bc6)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:08.040991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:08.103612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f508d5513a724701ad11cbb6c1bb8bc6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.104261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f508d5513a724701ad11cbb6c1bb8bc6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.105221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f508d5513a724701ad11cbb6c1bb8bc6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.118897 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f508d5513a724701ad11cbb6c1bb8bc6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.128667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f508d5513a724701ad11cbb6c1bb8bc6'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.141819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1278/2544] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:07 2021] DELETE /identity/v3/users/f508d5513a724701ad11cbb6c1bb8bc6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:08.146338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:08.147004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:08.147004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:08.164714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:08.165961 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:08.227598 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1267/2545] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:08.238904 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:08.241435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:08.329066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef2efe-4a61-4674-8e20-1219a057740e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:08.332783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:08.333462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:08.333744 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:08.334022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:08.344341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:08.345794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:08.355839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1279/2546] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:08.748669 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:08.751062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:08.767893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad848822-5205-4068-93d2-211e8fc650c3 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:08.773104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:08.774400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:08.774881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:08.775254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] PATH_INFO: `/v3/projects/6bd0c576f39d40fda88c2667250f4273` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:08.776560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd0c576f39d40fda88c2667250f4273)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:08.778721 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:08.834664 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd0c576f39d40fda88c2667250f4273', 'request_id': 'req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.841757 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd0c576f39d40fda88c2667250f4273', 'request_id': 'req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.847037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd0c576f39d40fda88c2667250f4273', 'request_id': 'req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.862939 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] The token cache is being invalidate because project 6bd0c576f39d40fda88c2667250f4273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:08.863424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.864403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:08.867077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1268/2547] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:08 2021] DELETE /identity/v3/projects/6bd0c576f39d40fda88c2667250f4273 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:08.871700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:08.882552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91a535-ad4d-46f3-8986-16427158bab0 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:08.948030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:08.948903 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:08.949187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:08.949463 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] PATH_INFO: `/v3/users/8ba654025bb64505ab4cf6da139dd746` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:08.950777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba654025bb64505ab4cf6da139dd746)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:08.952713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:09.000671 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba654025bb64505ab4cf6da139dd746'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.001338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba654025bb64505ab4cf6da139dd746'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.002014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba654025bb64505ab4cf6da139dd746'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.014634 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba654025bb64505ab4cf6da139dd746'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.022319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-2fa08cfd-e0fa-4510-a2b2-686d3acb17cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba654025bb64505ab4cf6da139dd746'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.035815 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1280/2548] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:08 2021] DELETE /identity/v3/users/8ba654025bb64505ab4cf6da139dd746 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:09.453112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:09.455275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:09.472337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7edff-528d-4a2a-a88a-e0bf18f675cc admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:09.593808 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:09.595411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:09.595911 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:09.596418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] PATH_INFO: `/v3/projects/b36c2e41352b408883055663599cd4d0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:09.598779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36c2e41352b408883055663599cd4d0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:09.602766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:09.679241 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36c2e41352b408883055663599cd4d0', 'request_id': 'req-b948136b-cc40-4bb0-b789-31f4a9ab6427'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.690448 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36c2e41352b408883055663599cd4d0', 'request_id': 'req-b948136b-cc40-4bb0-b789-31f4a9ab6427'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.701397 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36c2e41352b408883055663599cd4d0', 'request_id': 'req-b948136b-cc40-4bb0-b789-31f4a9ab6427'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.724084 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] The token cache is being invalidate because project b36c2e41352b408883055663599cd4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:09.724972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.725691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-b948136b-cc40-4bb0-b789-31f4a9ab6427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:09.728406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1269/2549] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:09 2021] DELETE /identity/v3/projects/b36c2e41352b408883055663599cd4d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:09.737284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:09.737621 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:09.738018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:09.761556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:09.764201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:09.853373 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1281/2550] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:09.867971 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:09.868479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:09.868932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:09.900113 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:09.902062 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:09.917140 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1270/2551] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:09.924553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:09.941118 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3451ff-000c-4005-81e0-ef2591aa1cab None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:09.948531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:09.949501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:09.949734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:09.950117 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:09.951592 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:09.952258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:09.955330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:09.976162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1282/2552] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:51:09.981157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:09.996028 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be3d3-7a6f-4217-b3c6-3ee8a19fce8f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.005077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.006257 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.006785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.007229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.008597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.012013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.060182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1271/2553] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:09 2021] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:10.062124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.092116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750565d-8467-4175-aebc-e2e2cf068951 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.245419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.249224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.249915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.250444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.251902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.256253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.294434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1283/2554] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:10 2021] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:10.300522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.319459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fce5f-ba3c-4b91-aeaf-13b0f4aba41b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.328411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.329134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.331032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.331032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.331552 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.335575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.362539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1272/2555] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:10 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:10.366396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.384467 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382a873-666f-4c2c-b789-b990dd525f0a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.392739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.393900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.394419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.394971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.396429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.399682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd4a2-6052-4f5f-9d19-79aae2c3511d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.421276 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1284/2556] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:10 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:10.425788 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.443720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786f51-a511-4e41-8417-ca3a03e79e73 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.451143 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.452265 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.452550 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.453048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] PATH_INFO: `/v3/projects/48eebb7e936e47bea7fc6a7af1cd3705/users/9850c862fcb64bba9896059dd344d9bd/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.473688 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48eebb7e936e47bea7fc6a7af1cd3705, user_id=9850c862fcb64bba9896059dd344d9bd, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.477404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.495865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1273/2557] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:10 2021] PUT /identity/v3/projects/48eebb7e936e47bea7fc6a7af1cd3705/users/9850c862fcb64bba9896059dd344d9bd/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:10.507813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.508491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.509059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.568542 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] MFA Rules not processed for user `9850c862fcb64bba9896059dd344d9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:10.569810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:10.666200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1285/2558] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:10 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:10.672861 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.756018 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90340-c634-47ef-b8c8-ea2a8b5583a9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.764987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.766089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.766302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.766964 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.767895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.769838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.799272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1274/2559] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:10 2021] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:10.803953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.815338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df438cb-7188-448d-b178-2ee9e0f16640 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.890745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.892154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.892652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.893172 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.895700 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.899704 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.938742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1286/2560] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:10 2021] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:10.941229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.957139 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bd36-5fde-462e-ba11-6193daf7cdb5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:10.962997 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:10.963686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:10.963972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:10.964253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:10.965054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:10.967378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:10.980005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1275/2561] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:10 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:10.984333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:10.994989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e6ed1-d749-454d-8e5b-596b561d3e38 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.000762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.001437 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.002211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.002211 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.002770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.004431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c632ef2-bad4-476b-af43-67636c8fc09c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.015264 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1287/2562] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:11.019594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.032004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d318f-ff81-461a-8c16-11b8151db6cd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.038402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.039568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.039921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.040268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] PATH_INFO: `/v3/projects/7b64b122f3844bd9a7c83202838320bd/users/eecdcbd402e142f585b643fb1b78d2a0/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.061112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b64b122f3844bd9a7c83202838320bd, user_id=eecdcbd402e142f585b643fb1b78d2a0, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.064085 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.085207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1276/2563] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:11 2021] PUT /identity/v3/projects/7b64b122f3844bd9a7c83202838320bd/users/eecdcbd402e142f585b643fb1b78d2a0/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:11.101398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.109769 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.110204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.145766 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] MFA Rules not processed for user `eecdcbd402e142f585b643fb1b78d2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:11.147229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:11.224456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1288/2564] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:11 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:11.229444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.307145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6f13-84f3-4a74-8591-b6420302534c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.313400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.314297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.314831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.315212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.316037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.318080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.351044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1277/2565] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:11 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:11.355261 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.369260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c205c-5fda-4d2f-8d7c-88e00383cd9a None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.435285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.436142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.436436 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.436714 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.437471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.439453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.464069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1289/2566] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:11 2021] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:11.468314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.479873 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc773c-ae8c-4900-b9d5-d3cdec538e5b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.485781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.486530 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.487044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.487251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.488325 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.489946 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.502724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1278/2567] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:11 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:11.508209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.522417 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10aec-1ec4-4d10-ab30-0a3457c2868a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.528316 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.529419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.529795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.530186 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] PATH_INFO: `/v3/projects/c8fa8d81dd274923b4a5de29195e9b21/users/8dc801bab6ec47cbb494f906b0225b29/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.550429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fa8d81dd274923b4a5de29195e9b21, user_id=8dc801bab6ec47cbb494f906b0225b29, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.553201 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.570356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1290/2568] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:11 2021] PUT /identity/v3/projects/c8fa8d81dd274923b4a5de29195e9b21/users/8dc801bab6ec47cbb494f906b0225b29/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:11.571630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.583037 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e2e86-75f5-4c13-8a6d-b446fb75cf95 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.645464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.646144 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.646429 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.646742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.647480 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.649118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ec7f-16d2-4cd0-8e19-227b4d0a6fd6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.660991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1279/2569] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:11 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:11.665180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.676762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4b50c-b54b-4eef-ba4e-d9d49f00c38d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.681964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.682916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.683340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.683628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] PATH_INFO: `/v3/projects/c8fa8d81dd274923b4a5de29195e9b21/users/8dc801bab6ec47cbb494f906b0225b29/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.686041 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fa8d81dd274923b4a5de29195e9b21, user_id=8dc801bab6ec47cbb494f906b0225b29, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.688830 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.700727 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1291/2570] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:11 2021] PUT /identity/v3/projects/c8fa8d81dd274923b4a5de29195e9b21/users/8dc801bab6ec47cbb494f906b0225b29/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:11.711568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.711867 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.712157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.744591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] MFA Rules not processed for user `8dc801bab6ec47cbb494f906b0225b29`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:11.745893 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:11.832511 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1280/2571] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:11 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:11.844386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:11.846077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:11.932673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b208-1abe-43ad-a40b-df5c6d4054b7 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:11.937308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:11.938458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:11.938458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:11.938458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:11.951362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:11.952728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:11.962820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1292/2572] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:11 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:12.014255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:12.017087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:12.032082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a3bf-f0a5-4382-b0b8-620bd6a418a5 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:12.036093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:12.036769 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:12.037051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:12.037327 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:12.117762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:12.119272 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:12.134169 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1281/2573] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:12 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:51:14.094866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:14.096341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:14.156184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfcc56-7c2a-4190-ade9-b478173f2bc7 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:14.160062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:14.160711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:14.160997 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:14.161356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:14.163121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:14.228059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:14.229501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a5674-fc9d-4552-9a50-b78ca93dfd45 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:14.241168 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1293/2574] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:14.993160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:15.005479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f07f7-bd80-4db2-a8fe-c0a210a29cda service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:15.011108 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:15.012130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:15.012972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:15.013484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] PATH_INFO: `/v3/users/9850c862fcb64bba9896059dd344d9bd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:15.015019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9850c862fcb64bba9896059dd344d9bd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:15.017168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:15.071252 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9850c862fcb64bba9896059dd344d9bd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.072610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9850c862fcb64bba9896059dd344d9bd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.081720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9850c862fcb64bba9896059dd344d9bd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.096625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9850c862fcb64bba9896059dd344d9bd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.104326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9850c862fcb64bba9896059dd344d9bd'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.110994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1282/2575] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:14 2021] DELETE /identity/v3/users/9850c862fcb64bba9896059dd344d9bd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:15.116101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:15.116648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:15.116648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:15.135758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:15.136994 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:15.200754 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1294/2576] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:15.211603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:15.213153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:15.288732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd8b95-f9a0-4b75-a0e7-02cc90ae7a82 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:15.292643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:15.293316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:15.294293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:15.294639 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:15.307982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:15.310270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:15.323453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1283/2577] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:15.784379 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:15.786789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:15.805946 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8a78-53a6-441c-8e9e-2250480e0798 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:15.811214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:15.812349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:15.812638 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:15.812921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] PATH_INFO: `/v3/projects/48eebb7e936e47bea7fc6a7af1cd3705` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:15.814411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48eebb7e936e47bea7fc6a7af1cd3705)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:15.816668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:15.891495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48eebb7e936e47bea7fc6a7af1cd3705', 'request_id': 'req-680d07dd-a847-499a-94d2-77b253bae85a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.897035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48eebb7e936e47bea7fc6a7af1cd3705', 'request_id': 'req-680d07dd-a847-499a-94d2-77b253bae85a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.904528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48eebb7e936e47bea7fc6a7af1cd3705', 'request_id': 'req-680d07dd-a847-499a-94d2-77b253bae85a'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.923838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] The token cache is being invalidate because project 48eebb7e936e47bea7fc6a7af1cd3705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:15.924490 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.925703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:15.927933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1295/2578] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:15 2021] DELETE /identity/v3/projects/48eebb7e936e47bea7fc6a7af1cd3705 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:15.932230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:15.943134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11915a20-4383-4151-8f27-07abc7c5a08c service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:16.023147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:16.024094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:16.024557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:16.024844 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] PATH_INFO: `/v3/users/eecdcbd402e142f585b643fb1b78d2a0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:16.026123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eecdcbd402e142f585b643fb1b78d2a0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:16.028942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:16.097009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eecdcbd402e142f585b643fb1b78d2a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.097851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eecdcbd402e142f585b643fb1b78d2a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.108901 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eecdcbd402e142f585b643fb1b78d2a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.124592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eecdcbd402e142f585b643fb1b78d2a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.142170 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eecdcbd402e142f585b643fb1b78d2a0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.149834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1284/2579] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:15 2021] DELETE /identity/v3/users/eecdcbd402e142f585b643fb1b78d2a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:16.486775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:16.488976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:16.528428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d07dd-a847-499a-94d2-77b253bae85a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:16.601083 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:16.601998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:16.602319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:16.602651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] PATH_INFO: `/v3/projects/7b64b122f3844bd9a7c83202838320bd` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:16.603919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b64b122f3844bd9a7c83202838320bd)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:16.606034 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:16.660218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b64b122f3844bd9a7c83202838320bd', 'request_id': 'req-7bda6742-2ff7-45b1-a340-e707e48f96b0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.666339 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b64b122f3844bd9a7c83202838320bd', 'request_id': 'req-7bda6742-2ff7-45b1-a340-e707e48f96b0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.673143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b64b122f3844bd9a7c83202838320bd', 'request_id': 'req-7bda6742-2ff7-45b1-a340-e707e48f96b0'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.686895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] The token cache is being invalidate because project 7b64b122f3844bd9a7c83202838320bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:16.687284 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.687940 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.689494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1296/2580] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:16 2021] DELETE /identity/v3/projects/7b64b122f3844bd9a7c83202838320bd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:16.693619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:16.695437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:16.709348 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f270f4e-a494-4ad9-8ffe-27cb2259eefb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:16.780970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:16.781868 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:16.782292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:16.782620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] PATH_INFO: `/v3/users/8dc801bab6ec47cbb494f906b0225b29` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:16.783852 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc801bab6ec47cbb494f906b0225b29)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:16.786302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:16.840405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc801bab6ec47cbb494f906b0225b29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.841124 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc801bab6ec47cbb494f906b0225b29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.848269 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc801bab6ec47cbb494f906b0225b29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.862041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc801bab6ec47cbb494f906b0225b29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.869972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2bb4a003-63b1-42aa-ad6e-945208e529d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc801bab6ec47cbb494f906b0225b29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:16.877937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1285/2581] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:16 2021] DELETE /identity/v3/users/8dc801bab6ec47cbb494f906b0225b29 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:17.206809 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.208470 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:17.224054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda6742-2ff7-45b1-a340-e707e48f96b0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.289731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.290645 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.290931 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.291250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] PATH_INFO: `/v3/projects/c8fa8d81dd274923b4a5de29195e9b21` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.292471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fa8d81dd274923b4a5de29195e9b21)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.295961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.349608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fa8d81dd274923b4a5de29195e9b21', 'request_id': 'req-09813302-7810-447b-a0db-9de69d1d3724'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.356493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fa8d81dd274923b4a5de29195e9b21', 'request_id': 'req-09813302-7810-447b-a0db-9de69d1d3724'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.365370 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fa8d81dd274923b4a5de29195e9b21', 'request_id': 'req-09813302-7810-447b-a0db-9de69d1d3724'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.381111 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] The token cache is being invalidate because project c8fa8d81dd274923b4a5de29195e9b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:17.381665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.382731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-09813302-7810-447b-a0db-9de69d1d3724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.384504 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1297/2582] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:17 2021] DELETE /identity/v3/projects/c8fa8d81dd274923b4a5de29195e9b21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:17.391822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.392521 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.392921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.420724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:17.422044 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:17.515340 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1286/2583] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:17.529340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.529859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.530255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.563522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:17.565294 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:17.573541 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1298/2584] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:17.578276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.590032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89fb3b-012f-47e7-9159-3076f9282ac0 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.603324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.603324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.603324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.603324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.604091 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:17.604394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.606897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.620771 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1287/2585] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:51:17.625500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.635185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb789a7-4221-4b9d-91d4-6bd7dfb7a218 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.643970 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.644740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.645027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.645392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.646144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.648145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.686882 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1299/2586] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:17 2021] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:17.691133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.693751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.696749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:17.711384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72823648-cf10-4656-b31a-463b960cd064 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.795894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.796594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.797068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.797535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.798282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.800389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.817324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568cb49-8b3a-4d24-a893-58e3101d7693 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.822279 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.823581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.823759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1288/2587] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:17 2021] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:17.823859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.824132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] PATH_INFO: `/v3/users/a8a8c3c685aa49499037c493b1b99eed` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.825739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a8c3c685aa49499037c493b1b99eed)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.827907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.828037 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.838341 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337e13f-80f9-425f-baaa-1b6ebd6c0b0e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.844200 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.844870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.845246 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.845431 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.846186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.847869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.861583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1289/2588] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:17.866975 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.880435 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ccee9-f2de-4878-b417-e0e130ae4ef4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.886046 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.886781 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.887069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.887481 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.888286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.889905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.890631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a8c3c685aa49499037c493b1b99eed'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.891749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a8c3c685aa49499037c493b1b99eed'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.892472 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a8c3c685aa49499037c493b1b99eed'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.901222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1290/2589] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:17.906342 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:17.907528 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a8c3c685aa49499037c493b1b99eed'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.909206 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:17.917422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-fde47948-8edf-4500-b443-bf8724b5f9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a8c3c685aa49499037c493b1b99eed'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:17.924508 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4712c1c-9908-4ec5-8748-76acea4bd5f1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:17.929507 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:17.930402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.930713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.930988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] PATH_INFO: `/v3/projects/44c9c1891789491bbcae9bca7f8654f2/users/1ca3422951ef4ccc8f40838ba2532bbf/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:17.931141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1300/2590] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:17 2021] DELETE /identity/v3/users/a8a8c3c685aa49499037c493b1b99eed => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:17.949150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c9c1891789491bbcae9bca7f8654f2, user_id=1ca3422951ef4ccc8f40838ba2532bbf, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:17.952202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:17.972250 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1291/2591] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:17 2021] PUT /identity/v3/projects/44c9c1891789491bbcae9bca7f8654f2/users/1ca3422951ef4ccc8f40838ba2532bbf/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:17.977536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:17.977833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:17.978171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.001642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:18.003088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.068760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1301/2592] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:18.084232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.086375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.168175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b7f74-b0b4-4f82-ae92-e3eb1d937f29 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.173634 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.174361 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.174692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.174974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.188855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.190657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b66927-0aec-4450-81a1-847ded63f64f service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.203847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1292/2593] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:18.396187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.397974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.412426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5295a79-62d0-47c7-8077-5962e37a7ccc None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.419531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.420481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.420770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.421072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] PATH_INFO: `/v3/projects/caed8624c42e4e4aab79cb3ca12ef824` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.422349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=caed8624c42e4e4aab79cb3ca12ef824)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.425060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.479004 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caed8624c42e4e4aab79cb3ca12ef824', 'request_id': 'req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:18.486424 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caed8624c42e4e4aab79cb3ca12ef824', 'request_id': 'req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:18.493055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caed8624c42e4e4aab79cb3ca12ef824', 'request_id': 'req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:18.507469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] The token cache is being invalidate because project caed8624c42e4e4aab79cb3ca12ef824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:18.508015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:18.508687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51eb1c66-1617-4eb9-b78c-d29981bf1b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:18.510268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1302/2594] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:18 2021] DELETE /identity/v3/projects/caed8624c42e4e4aab79cb3ca12ef824 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:18.518398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.518398 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.519353 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.542432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:18.544228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.612055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1293/2595] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:18.620858 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.621399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.621399 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.641623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:18.643432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.651916 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1303/2596] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:18.657477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.668073 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee86adc-84fa-400b-8927-4cbc9f8533d1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.674160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.674989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.675335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.675716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.676555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:18.676938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.678645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.691427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1294/2597] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:51:18.695748 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.707338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e4c8c-bc7b-4816-860d-ba131b11f228 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.712694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.713353 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.713623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.713901 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.714666 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.716795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.744964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1304/2598] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:18 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:18.749703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.760354 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e80ce-25a6-4792-9c0f-d40c77b73995 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.827924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.828619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.829038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.829322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.830059 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.832060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.857218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1295/2599] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:18 2021] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:18.858619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.869415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668e847-00d0-4491-b92d-eaf0b76eff99 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.876204 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.876918 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.877241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.877529 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.878323 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.880134 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a595d-a212-4877-84ee-ed66a29d7bc1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.893262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1305/2600] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:18 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:18.897560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.916014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fea931-1528-4128-880b-f94f49cdb020 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.927383 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.928082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.928406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.928686 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.929770 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.931494 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:18.933585 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.933974 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.934896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.944054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1296/2601] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:18 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:18.947924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:18.961048 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb876d-2c13-4c41-9aa5-9669731fd96e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:18.967052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:18.967967 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:18.968322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:18.968641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] PATH_INFO: `/v3/projects/febfd0d2b97548e9b05a3222c5df7878/users/7df4616b86b446f5af955b9d6fa320ef/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:18.970942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] MFA Rules not processed for user `1ca3422951ef4ccc8f40838ba2532bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:18.972998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:18.987106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=febfd0d2b97548e9b05a3222c5df7878, user_id=7df4616b86b446f5af955b9d6fa320ef, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:18.990163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38610e1-783a-46e9-89ff-5721d7529edd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.008382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1297/2602] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:18 2021] PUT /identity/v3/projects/febfd0d2b97548e9b05a3222c5df7878/users/7df4616b86b446f5af955b9d6fa320ef/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:19.021765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.022114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.022329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.049875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1306/2603] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:18 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:19.059047 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] MFA Rules not processed for user `7df4616b86b446f5af955b9d6fa320ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:19.061489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:19.065376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.067359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:19.138262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dde32a-e0ad-41e2-b2db-5bc62a476a47 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.139444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1298/2604] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:19 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:19.144013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.192497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.193155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.193441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.193724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.211443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679ac7f-ca34-45fd-9b7f-c75ddb0d6c56 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.216740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.217502 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.217897 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.218180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.219087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.221052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.249064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1299/2605] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:19 2021] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:19.253419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.253588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.255051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.265396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1307/2606] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:19 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:51:19.320336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cb8fb-3ae0-4a66-b163-8d1087aa5d69 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.326184 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.327132 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.327541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.327765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.328443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.330450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.352714 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1300/2607] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:19 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:19.357927 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.369318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a6aa6-2212-41e7-8451-21328806a1cb service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.375626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.376320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.376581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.376859 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.377614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.379287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.389758 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1308/2608] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:19 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:19.394070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.405570 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b541046-f96a-4057-ab3b-fd6d5807711a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.411194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.412205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.412571 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.412857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] PATH_INFO: `/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd/users/e146ea1e78b54e9487d41dbebcc056b0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.430801 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c8b3bc02264f9c9ba6d4f56f4e8cbd, user_id=e146ea1e78b54e9487d41dbebcc056b0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.433536 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.446989 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1301/2609] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:19 2021] PUT /identity/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd/users/e146ea1e78b54e9487d41dbebcc056b0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:19.451183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.462330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f19006-646a-445c-b873-c9ae0a0bebcb admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.535568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.536338 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.536697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.537054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.537954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.540237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e0a4e-8e00-4602-a5a0-db5fe8cab961 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.553332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1309/2610] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:19 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:19.557414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.569382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7986a3-618e-4e8b-b1d3-bf357a20fbb9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.575409 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.576399 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.576907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.577256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] PATH_INFO: `/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd/users/e146ea1e78b54e9487d41dbebcc056b0/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.579420 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c8b3bc02264f9c9ba6d4f56f4e8cbd, user_id=e146ea1e78b54e9487d41dbebcc056b0, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.582220 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.595761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1302/2611] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:19 2021] PUT /identity/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd/users/e146ea1e78b54e9487d41dbebcc056b0/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:19.608253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.608603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.608960 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.638203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] MFA Rules not processed for user `e146ea1e78b54e9487d41dbebcc056b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:19.639453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:19.708137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1310/2612] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:19 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:19.720212 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:19.776793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d25d4-b6f3-4c4c-a136-7bacfcf99928 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:19.781762 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:19.782432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:19.782730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:19.783005 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:19.792573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:19.794027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce9a0-083d-47a3-a0d1-01cc56b242f3 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:19.804972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1303/2613] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:19 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:20.112155 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:20.179598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ac881-86ed-4f3b-bce4-126b2518c344 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:20.184764 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:20.185630 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.185915 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.186195 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] PATH_INFO: `/v3/users/7df4616b86b446f5af955b9d6fa320ef` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.187478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df4616b86b446f5af955b9d6fa320ef)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:20.189421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:20.237395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df4616b86b446f5af955b9d6fa320ef'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.238054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df4616b86b446f5af955b9d6fa320ef'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.238697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df4616b86b446f5af955b9d6fa320ef'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.250647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df4616b86b446f5af955b9d6fa320ef'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.257861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df4616b86b446f5af955b9d6fa320ef'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.274921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1311/2614] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:20 2021] DELETE /identity/v3/users/7df4616b86b446f5af955b9d6fa320ef => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:20.280588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91b247-3e89-4fdd-b322-803342a19f25 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.280866 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91b247-3e89-4fdd-b322-803342a19f25 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.281153 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91b247-3e89-4fdd-b322-803342a19f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.299364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1c91b247-3e89-4fdd-b322-803342a19f25 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:20.300568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1c91b247-3e89-4fdd-b322-803342a19f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:20.361063 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1304/2615] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:20.371263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:20.373282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:20.428493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e68721-c439-4860-b192-b0f2c1dc6382 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:20.432324 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:20.432986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.433260 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.433540 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.443489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:20.444905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:20.456043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1312/2616] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:20.647858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.648444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.648444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.666068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] MFA Rules not processed for user `1ca3422951ef4ccc8f40838ba2532bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:20.667352 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:20.729928 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1305/2617] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:20.738364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:20.740765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:20.757763 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756e948-ed03-4178-8691-7cbef601c1c4 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:20.763574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:20.764452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.766981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.767169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] PATH_INFO: `/v3/projects/febfd0d2b97548e9b05a3222c5df7878` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.768476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=febfd0d2b97548e9b05a3222c5df7878)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:20.770588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:20.822893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febfd0d2b97548e9b05a3222c5df7878', 'request_id': 'req-7bf4ff6f-5cb8-4517-96a2-a3a980975093'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.829794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febfd0d2b97548e9b05a3222c5df7878', 'request_id': 'req-7bf4ff6f-5cb8-4517-96a2-a3a980975093'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.840029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febfd0d2b97548e9b05a3222c5df7878', 'request_id': 'req-7bf4ff6f-5cb8-4517-96a2-a3a980975093'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.854555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] The token cache is being invalidate because project febfd0d2b97548e9b05a3222c5df7878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:20.854926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.855571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.857831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1313/2618] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:20 2021] DELETE /identity/v3/projects/febfd0d2b97548e9b05a3222c5df7878 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:20.862597 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:20.874463 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bb8e9-f083-48aa-9c3b-dfd63873487b None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:20.938914 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:20.939821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:20.940193 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:20.940470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] PATH_INFO: `/v3/users/e146ea1e78b54e9487d41dbebcc056b0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:20.941735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e146ea1e78b54e9487d41dbebcc056b0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:20.943776 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:20.993561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:20.994986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:20.996294 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e146ea1e78b54e9487d41dbebcc056b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:20.997219 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e146ea1e78b54e9487d41dbebcc056b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.005717 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e146ea1e78b54e9487d41dbebcc056b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.019087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e146ea1e78b54e9487d41dbebcc056b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.027566 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e146ea1e78b54e9487d41dbebcc056b0'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.034484 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1306/2619] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:20 2021] DELETE /identity/v3/users/e146ea1e78b54e9487d41dbebcc056b0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:21.064229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ff6f-5cb8-4517-96a2-a3a980975093 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.123026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.123778 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.124140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.124419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.130980 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:21.141524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.143025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2307158-f3d6-4ba9-8789-238a4f4fb643 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.151496 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1314/2620] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:51:21.444828 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.446359 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:21.524268 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a128-6505-44f7-bb5f-9eb909166661 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.530332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.531234 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.531516 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.531795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] PATH_INFO: `/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.533670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c8b3bc02264f9c9ba6d4f56f4e8cbd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.535644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.587745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c8b3bc02264f9c9ba6d4f56f4e8cbd', 'request_id': 'req-348a675c-cf49-41b1-9f65-1b8f1fd86650'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.594615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c8b3bc02264f9c9ba6d4f56f4e8cbd', 'request_id': 'req-348a675c-cf49-41b1-9f65-1b8f1fd86650'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.602584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c8b3bc02264f9c9ba6d4f56f4e8cbd', 'request_id': 'req-348a675c-cf49-41b1-9f65-1b8f1fd86650'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.617014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] The token cache is being invalidate because project 10c8b3bc02264f9c9ba6d4f56f4e8cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:21.617304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.617942 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-348a675c-cf49-41b1-9f65-1b8f1fd86650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:21.619548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1307/2621] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:21 2021] DELETE /identity/v3/projects/10c8b3bc02264f9c9ba6d4f56f4e8cbd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:21.627027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.627464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.627857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.647251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:21.648406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:21.707895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1315/2622] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:21.716203 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.716729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.716830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.735622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:21.736851 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:21.747068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1308/2623] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:21.751875 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.761639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e88bf6-5fbb-412f-9916-13f6a1c62893 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.769003 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.769695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.770008 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.770289 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.771137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:21.771448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.773121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.787156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1316/2624] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 08:51:21.791499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.801249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c876-5cb7-44e1-b633-10399124245e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.806723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.807421 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.807689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.807990 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.808718 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.811286 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.838603 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1309/2625] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:21 2021] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:21.842827 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.853070 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d20420-15a0-476c-a398-62ea3b885c69 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.913905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.914491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.914814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.915098 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.915932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.917987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.939731 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1317/2626] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:21 2021] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:21.944010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.955619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781b226-5202-4e45-bcf6-73086c527407 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.960406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.961335 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.961616 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.961890 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.962673 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.964287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:21.976641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1310/2627] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:21.980687 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:21.990907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12f198-1c59-433a-a216-6d45322fc999 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:21.995662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:21.996331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:21.997125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:21.997408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:21.998154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:21.999810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d98be9-da1e-4427-8016-bdcbef566ae8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.009966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1318/2628] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:22.014974 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.024827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb3ff2-4858-48ba-a11b-9284345d1de4 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.030593 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.031483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.031759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.032039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] PATH_INFO: `/v3/projects/22bebd51e295493fb1fa72668d13d351/users/c9904eded78c4c46bf560d965b36b1e5/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.047101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bebd51e295493fb1fa72668d13d351, user_id=c9904eded78c4c46bf560d965b36b1e5, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.049751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.063314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1311/2629] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:22 2021] PUT /identity/v3/projects/22bebd51e295493fb1fa72668d13d351/users/c9904eded78c4c46bf560d965b36b1e5/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:22.073935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.074229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.074525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.103577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] MFA Rules not processed for user `c9904eded78c4c46bf560d965b36b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:22.105060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:22.172779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1319/2630] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:22 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:22.177230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.242288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2159-14dd-4c1d-af86-678b118fb1a6 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.248021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.248700 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.248987 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.249270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.249981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.251938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.277563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1312/2631] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:22 2021] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:22.281668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.292365 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab006550-81d3-42e7-9f62-6713ef2f7c1d None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.347760 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.348429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.348713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.348993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.349707 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.351662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.373537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1320/2632] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:22 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:22.377684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.387981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66e1a0-e9a8-45fd-bf60-7a58fc66a6eb admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.392916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.393582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.393871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.394168 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.394952 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.396592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.407706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1313/2633] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:22.411806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.422597 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476eac-8fb3-423f-82f8-94915323802c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.427368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.428185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.428471 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.428749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] PATH_INFO: `/v3/projects/9b4f7cb7098240738fd8a7efeacb4885/users/ead526d2853b433b97591c19b7460683/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.443729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4f7cb7098240738fd8a7efeacb4885, user_id=ead526d2853b433b97591c19b7460683, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.446388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.460010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1321/2634] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:22 2021] PUT /identity/v3/projects/9b4f7cb7098240738fd8a7efeacb4885/users/ead526d2853b433b97591c19b7460683/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:22.464256 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.475605 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c799ea-c481-45d2-a65d-e907023de754 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.531865 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.532535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.532821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.533098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.533847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.535542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.546263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1314/2635] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:22 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:22.550691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.561422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869682c1-fdf1-47a4-abb8-208503ef1787 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.566691 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.568103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.568395 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.569088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] PATH_INFO: `/v3/projects/9b4f7cb7098240738fd8a7efeacb4885/users/ead526d2853b433b97591c19b7460683/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.571305 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4f7cb7098240738fd8a7efeacb4885, user_id=ead526d2853b433b97591c19b7460683, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.574218 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc744068-e4e6-496c-9401-211fca81d098 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.586197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1322/2636] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:22 2021] PUT /identity/v3/projects/9b4f7cb7098240738fd8a7efeacb4885/users/ead526d2853b433b97591c19b7460683/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:22.596728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.597685 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.598108 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.598398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.598568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:22.627115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] MFA Rules not processed for user `ead526d2853b433b97591c19b7460683`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:22.628334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:22.682908 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88240e75-9dcb-4c0d-8455-5703e594f350 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.708697 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1323/2637] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:22 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:22.720381 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.721821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:22.745919 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.746655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.747055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.747382 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.749328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:22.760927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.763095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.773396 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1315/2638] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:22 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:22.780262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626b2f-1b2a-4ba5-b96d-b6ecda7552a4 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.784055 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.784703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.784979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.785265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.794647 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.796197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.806090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1324/2639] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:22 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:51:22.882378 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:22.893098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585529e-563a-42ff-8006-6f9f0fa65915 service placement] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:22.896792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:22.897506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:22.897789 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:22.898066 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:22.955670 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:22.956903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7e51-091e-42fe-a1d0-1635d388a01d service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:22.967036 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1316/2640] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:22 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:33.254724 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:33.325899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1a211-35c4-44bf-b45a-932cc6f9f049 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:33.331357 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:33.332478 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:33.332658 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:33.332989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] PATH_INFO: `/v3/users/c9904eded78c4c46bf560d965b36b1e5` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:33.334510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9904eded78c4c46bf560d965b36b1e5)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:33.337137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:33.392767 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9904eded78c4c46bf560d965b36b1e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:33.393455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9904eded78c4c46bf560d965b36b1e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:33.394184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9904eded78c4c46bf560d965b36b1e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:33.410052 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9904eded78c4c46bf560d965b36b1e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:33.424520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9904eded78c4c46bf560d965b36b1e5'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:33.441290 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1325/2641] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:33 2021] DELETE /identity/v3/users/c9904eded78c4c46bf560d965b36b1e5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:33.449310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:33.449981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:33.450179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:33.476466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:33.478185 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:33.564965 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1317/2642] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:33.579776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:33.581291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:33.656594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73906d7e-72a3-473e-a82b-2ec4c8f08be4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:33.663428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:33.664582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:33.664990 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:33.665464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:33.680115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:33.682566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:33.699821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1326/2643] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:34.076300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:34.080461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:34.111722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a8051-c8a1-49e8-bce2-ce1d570b1ab2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:34.123362 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:34.125228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:34.133729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:34.133729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] PATH_INFO: `/v3/projects/22bebd51e295493fb1fa72668d13d351` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:34.133729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bebd51e295493fb1fa72668d13d351)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:34.133729 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:34.196628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bebd51e295493fb1fa72668d13d351', 'request_id': 'req-ccae5970-d2e6-47c5-a993-bc5ee439511c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.208253 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bebd51e295493fb1fa72668d13d351', 'request_id': 'req-ccae5970-d2e6-47c5-a993-bc5ee439511c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.218874 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bebd51e295493fb1fa72668d13d351', 'request_id': 'req-ccae5970-d2e6-47c5-a993-bc5ee439511c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.237883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] The token cache is being invalidate because project 22bebd51e295493fb1fa72668d13d351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:34.238174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.238859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.240487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1318/2644] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:34 2021] DELETE /identity/v3/projects/22bebd51e295493fb1fa72668d13d351 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:34.246446 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:34.260372 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6031-386a-436f-bc82-96f4ec17b752 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:34.331894 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:34.333009 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:34.333291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:34.333565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] PATH_INFO: `/v3/users/ead526d2853b433b97591c19b7460683` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:34.334911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead526d2853b433b97591c19b7460683)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:34.337171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:34.396241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead526d2853b433b97591c19b7460683'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.397094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead526d2853b433b97591c19b7460683'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.397932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead526d2853b433b97591c19b7460683'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.416268 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead526d2853b433b97591c19b7460683'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.425266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-86ba6cfb-1dd3-4dd3-9d77-418d4542487a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead526d2853b433b97591c19b7460683'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.444383 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1327/2645] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:34 2021] DELETE /identity/v3/users/ead526d2853b433b97591c19b7460683 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:34.749827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:34.752291 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:34.773452 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5970-d2e6-47c5-a993-bc5ee439511c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:34.854691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:34.857495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:34.857759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:34.858123 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] PATH_INFO: `/v3/projects/9b4f7cb7098240738fd8a7efeacb4885` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:34.860233 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4f7cb7098240738fd8a7efeacb4885)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:34.863517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:34.947007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4f7cb7098240738fd8a7efeacb4885', 'request_id': 'req-2390f916-9146-410b-ab98-85c9d66d110c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.955009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4f7cb7098240738fd8a7efeacb4885', 'request_id': 'req-2390f916-9146-410b-ab98-85c9d66d110c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.965072 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4f7cb7098240738fd8a7efeacb4885', 'request_id': 'req-2390f916-9146-410b-ab98-85c9d66d110c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.977737 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] The token cache is being invalidate because project 9b4f7cb7098240738fd8a7efeacb4885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:34.978064 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.978818 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-2390f916-9146-410b-ab98-85c9d66d110c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:34.980417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1319/2646] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:34 2021] DELETE /identity/v3/projects/9b4f7cb7098240738fd8a7efeacb4885 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:34.987374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:34.987651 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:34.987941 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.008531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:35.009676 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:35.083053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1328/2647] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:35.092213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.092646 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.093041 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.120434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:35.123093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:35.139004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1320/2648] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:35.145142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.158238 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea4e8-c805-4286-bf5e-6219d91ae0a9 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.163510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.164184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.164500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.164782 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.165554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:35.165934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.167516 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.181753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1329/2649] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:51:35.187210 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.197723 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14147131-6261-461e-b269-f639ae4d7d09 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.203836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.205278 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.205839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.206151 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.207115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.209504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.243116 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1321/2650] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:35.251242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.264565 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fba2f-dc8c-46fc-bcf4-4e6faa0de4f4 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.352677 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.353432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.353751 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.354619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.354921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.358374 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.385966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1330/2651] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:35.390655 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.404205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4f7d4-98c7-4ea3-9d0f-f23b0ebc2544 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.409956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.410727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.411019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.411297 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.412029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.413821 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.429856 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1322/2652] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:35 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:35.434773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.445983 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb4a0-dad8-4629-b38e-f474ea8b4b8a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.451510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.452188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.452481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.452756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.453614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.455415 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabd957-0986-42d1-a00f-d1848e08e4e4 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.470343 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1331/2653] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:35 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:35.476653 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.490109 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a696-9172-4f12-90fc-fc4e41c4c645 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.496221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.497656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.497985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.498258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] PATH_INFO: `/v3/projects/1f4d30cb0e884fe490f813db9b6e4bdd/users/c76e7a18e7d54623aca71b219c737506/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.516528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4d30cb0e884fe490f813db9b6e4bdd, user_id=c76e7a18e7d54623aca71b219c737506, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.519394 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.535698 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1323/2654] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:35 2021] PUT /identity/v3/projects/1f4d30cb0e884fe490f813db9b6e4bdd/users/c76e7a18e7d54623aca71b219c737506/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:35.547582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786595-f6c5-428c-8f40-360481efe77e None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.548196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786595-f6c5-428c-8f40-360481efe77e None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.548196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97786595-f6c5-428c-8f40-360481efe77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.583039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-97786595-f6c5-428c-8f40-360481efe77e None None] MFA Rules not processed for user `c76e7a18e7d54623aca71b219c737506`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:35.584438 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-97786595-f6c5-428c-8f40-360481efe77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:35.660416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1332/2655] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:35.665077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.732840 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638d4d-1600-440b-811e-98839b605660 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.738057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.738785 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.739068 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.739363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.740090 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.742006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.770744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1324/2656] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:35.774802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97786595-f6c5-428c-8f40-360481efe77e None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.785921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97786595-f6c5-428c-8f40-360481efe77e None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.848209 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.848891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.849185 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.849466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.850200 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.852205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.873847 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1333/2657] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:35 2021] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:35.880573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.897907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c743-d048-4c7c-a586-2f55c132f5c7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.906167 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.907261 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.907734 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.908192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.909488 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.912358 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.930459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1325/2658] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:35 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:35.935192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.945795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf16cd-2c15-4afd-9068-75fdcb7218f8 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.952322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.953019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.953297 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.953574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:35.954333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:35.956549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7f118-66d6-49d4-a1cd-33fb9277ab1e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:35.968262 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1334/2659] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:35.972825 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:35.984079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a87b55-89e0-49d9-8af6-cc0f0de48ece admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:35.990222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:35.990672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:35.990672 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:35.990944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] PATH_INFO: `/v3/projects/4d7c66c2312449fb9332332f3ff1f098/users/565df2c782d444c59533a5b1dbd2b6a3/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.008175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7c66c2312449fb9332332f3ff1f098, user_id=565df2c782d444c59533a5b1dbd2b6a3, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.010917 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.026687 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1326/2660] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:35 2021] PUT /identity/v3/projects/4d7c66c2312449fb9332332f3ff1f098/users/565df2c782d444c59533a5b1dbd2b6a3/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:36.037907 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.038194 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.038475 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.072469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] MFA Rules not processed for user `565df2c782d444c59533a5b1dbd2b6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:36.073878 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:36.188985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1335/2661] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:36 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:36.195024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.271094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d299d0d-721f-4c4d-99cd-014baa62a60e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.276288 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.277032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.277254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.277544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.278513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.280302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.312307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1327/2662] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:36 2021] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:36.316982 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.329082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f6fef-67bc-4434-90e8-691adb4728f3 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.405377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.406346 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.406674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.407067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.408230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.411568 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.437092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1336/2663] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:36 2021] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:36.443087 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.457078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc9c4-53c3-4604-9d6f-b70f6ba43f6a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.462992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.463931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.467660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.467660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.467660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.467660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.483834 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1328/2664] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:36 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:36.485050 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.498177 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92bff6-9e53-4a39-a890-33fcfa7ea75c admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.503359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.504221 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.504493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.504776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] PATH_INFO: `/v3/projects/ba5ed20525d244e0939b6506fa3b311b/users/7c0c7a199619451480978fa275aae530/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.521547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5ed20525d244e0939b6506fa3b311b, user_id=7c0c7a199619451480978fa275aae530, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.524303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.539307 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1337/2665] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:36 2021] PUT /identity/v3/projects/ba5ed20525d244e0939b6506fa3b311b/users/7c0c7a199619451480978fa275aae530/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:36.543582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.556551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408b67c-b808-4ac6-9d7c-c30102366cef admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.626743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.627425 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.627713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.627981 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.628735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.630376 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf8bd4-3f5b-4623-8d30-e0deb906e3c2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.648026 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1329/2666] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:36 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:36.655068 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.669026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58136258-9aa1-408b-9e97-90df4b428a05 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.675419 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.677158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.677158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.677158 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] PATH_INFO: `/v3/projects/ba5ed20525d244e0939b6506fa3b311b/users/7c0c7a199619451480978fa275aae530/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.679160 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5ed20525d244e0939b6506fa3b311b, user_id=7c0c7a199619451480978fa275aae530, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.682067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.696287 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1338/2667] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:36 2021] PUT /identity/v3/projects/ba5ed20525d244e0939b6506fa3b311b/users/7c0c7a199619451480978fa275aae530/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:36.711483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.712055 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.712613 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.751379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] MFA Rules not processed for user `7c0c7a199619451480978fa275aae530`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:36.752222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:36.843862 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1330/2668] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:36 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:36.859672 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:36.862069 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:36.945192 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6efbdc-1796-4100-9e22-9712c4308054 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:36.950229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:36.951115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:36.951402 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:36.951689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:36.962989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:36.964660 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:36.977579 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1339/2669] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:36 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:37.603934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:37.607379 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:37.630375 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13519cf-da23-4af9-a501-6fecf61c9abc None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:37.636858 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:37.638121 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:37.638657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:37.639160 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:37.729119 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:37.730641 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:37.745418 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1331/2670] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:37 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:39.121174 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:39.123623 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:39.211427 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431992e6-1606-4e9d-bbf1-d77baf1365dd service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:39.219094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:39.219765 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:39.220193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:39.220476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:39.222355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:39.238087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:39.239619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:39.252599 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1340/2671] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:41.871071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:41.880475 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d7da-ecc3-40e9-a3d1-6bc0c913076e service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:41.885133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:41.885991 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:41.886282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:41.886594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:41.946758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:41.948180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004c46b-ebf6-410a-9727-8170bd23a45d service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:41.958870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1332/2672] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:41 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:44.148845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:44.219384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b04ce5-66b5-4133-be70-e4d23814ddc8 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:44.224105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:44.224993 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:44.225263 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:44.225544 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] PATH_INFO: `/v3/users/c76e7a18e7d54623aca71b219c737506` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:44.226848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76e7a18e7d54623aca71b219c737506)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:44.228838 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:44.284497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76e7a18e7d54623aca71b219c737506'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.285267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76e7a18e7d54623aca71b219c737506'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.285877 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76e7a18e7d54623aca71b219c737506'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.299366 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76e7a18e7d54623aca71b219c737506'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.308636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76e7a18e7d54623aca71b219c737506'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.327362 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1341/2673] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:44 2021] DELETE /identity/v3/users/c76e7a18e7d54623aca71b219c737506 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:44.332384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:44.333532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:44.333532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:44.358244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:44.359995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:44.424319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1333/2674] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:44.434664 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:44.436105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:44.501430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32616-57b5-494a-a21e-2da92963ac00 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:44.505869 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:44.506662 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:44.506948 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:44.507225 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:44.518512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:44.520085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:44.531975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1342/2675] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:44.827730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:44.829560 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:44.865002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785525b-ed19-45ab-8479-675d02ba7f30 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:44.877984 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:44.879142 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:44.879427 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:44.879709 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] PATH_INFO: `/v3/projects/1f4d30cb0e884fe490f813db9b6e4bdd` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:44.881006 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4d30cb0e884fe490f813db9b6e4bdd)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:44.883094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:44.942290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4d30cb0e884fe490f813db9b6e4bdd', 'request_id': 'req-89007b06-0275-4a61-87d0-12b79d4b5f5c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.949069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4d30cb0e884fe490f813db9b6e4bdd', 'request_id': 'req-89007b06-0275-4a61-87d0-12b79d4b5f5c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.955627 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4d30cb0e884fe490f813db9b6e4bdd', 'request_id': 'req-89007b06-0275-4a61-87d0-12b79d4b5f5c'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.970764 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] The token cache is being invalidate because project 1f4d30cb0e884fe490f813db9b6e4bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:44.971050 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.971751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:44.973422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1334/2676] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:44 2021] DELETE /identity/v3/projects/1f4d30cb0e884fe490f813db9b6e4bdd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:44.977679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:44.987822 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3e534-cfa1-4c8b-ba67-4aa5d3adb642 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:45.048403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:45.049291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:45.049571 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:45.049849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] PATH_INFO: `/v3/users/565df2c782d444c59533a5b1dbd2b6a3` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:45.051116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=565df2c782d444c59533a5b1dbd2b6a3)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:45.053065 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:45.103569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '565df2c782d444c59533a5b1dbd2b6a3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.104432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '565df2c782d444c59533a5b1dbd2b6a3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.105103 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '565df2c782d444c59533a5b1dbd2b6a3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.117781 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '565df2c782d444c59533a5b1dbd2b6a3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.127151 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '565df2c782d444c59533a5b1dbd2b6a3'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.141093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1343/2677] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:44 2021] DELETE /identity/v3/users/565df2c782d444c59533a5b1dbd2b6a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:45.430674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:45.432175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:45.447089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89007b06-0275-4a61-87d0-12b79d4b5f5c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:45.510040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:45.510960 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:45.511242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:45.511517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] PATH_INFO: `/v3/projects/4d7c66c2312449fb9332332f3ff1f098` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:45.512950 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7c66c2312449fb9332332f3ff1f098)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:45.514935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:45.569553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7c66c2312449fb9332332f3ff1f098', 'request_id': 'req-ae1a099f-ec93-4dce-853b-0ccf56b22e29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.576513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7c66c2312449fb9332332f3ff1f098', 'request_id': 'req-ae1a099f-ec93-4dce-853b-0ccf56b22e29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.582147 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7c66c2312449fb9332332f3ff1f098', 'request_id': 'req-ae1a099f-ec93-4dce-853b-0ccf56b22e29'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.598615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] The token cache is being invalidate because project 4d7c66c2312449fb9332332f3ff1f098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:45.598615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.598615 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.600367 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1335/2678] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:45 2021] DELETE /identity/v3/projects/4d7c66c2312449fb9332332f3ff1f098 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:45.604762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:45.606848 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:45.620176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c0e7-67ac-40ca-9b3f-6465e722ede9 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:45.684073 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:45.684912 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:45.685205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:45.685480 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] PATH_INFO: `/v3/users/7c0c7a199619451480978fa275aae530` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:45.686840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0c7a199619451480978fa275aae530)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:45.688998 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:45.749392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0c7a199619451480978fa275aae530'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.749392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0c7a199619451480978fa275aae530'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.749392 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0c7a199619451480978fa275aae530'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.763689 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0c7a199619451480978fa275aae530'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.770607 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-65cb69df-c1b6-449c-968d-96cfc3a058e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0c7a199619451480978fa275aae530'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:45.785300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1344/2679] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:45 2021] DELETE /identity/v3/users/7c0c7a199619451480978fa275aae530 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:46.096165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.097860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:46.112796 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a099f-ec93-4dce-853b-0ccf56b22e29 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.177595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.178544 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.178833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.179133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] PATH_INFO: `/v3/projects/ba5ed20525d244e0939b6506fa3b311b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.180370 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5ed20525d244e0939b6506fa3b311b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.182343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.232759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5ed20525d244e0939b6506fa3b311b', 'request_id': 'req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:46.242118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5ed20525d244e0939b6506fa3b311b', 'request_id': 'req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:46.248454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5ed20525d244e0939b6506fa3b311b', 'request_id': 'req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:46.264650 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] The token cache is being invalidate because project ba5ed20525d244e0939b6506fa3b311b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:46.264994 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:46.265747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-8149fd3c-d0ab-4eeb-9e67-f22e98018a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:46.267666 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1336/2680] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:46 2021] DELETE /identity/v3/projects/ba5ed20525d244e0939b6506fa3b311b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:46.278384 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.278708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.278985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.296481 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:46.297721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:46.367738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1345/2681] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:46.378070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.378455 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.378682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.400071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:46.401540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:46.411089 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1337/2682] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:46.415450 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.426469 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa7ea-fe48-4604-9e0a-e2e06a39f0b6 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.431408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.432026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.432311 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.432588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.433349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:46.433654 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.436002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.448936 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1346/2683] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:51:46.454222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.465386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5fb2-3e8e-4db8-9ebb-2aa335e02896 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.470657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.471343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.471630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.471910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.472632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.474588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.503054 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1338/2684] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:46.507819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.520952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5860be8-3468-4412-bf16-db287b0f4c64 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.581152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.581829 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.582116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.582391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.583147 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.585088 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.607637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1347/2685] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:46.612402 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.622896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f624e-8c9e-4fe0-976c-7c2c46c812a1 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.627742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.628419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.628707 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.628995 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.629749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.631601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.646826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1339/2686] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:46 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:46.654661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.665193 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91a74-82d0-4cc2-aa27-07bff6311873 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.672729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.673428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.673771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.674048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.674925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.676711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fab01-4ce4-452e-b769-6316516599aa admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.688256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1348/2687] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:46.692067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.703077 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d404c-9161-42fe-91c2-cc347857b07c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.709103 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.710012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.710296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.710730 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] PATH_INFO: `/v3/projects/feafc5065b574eabb2c69f0578b9e311/users/9a9e704ff39d4d89a6f7841dc7a2278a/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.728106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=feafc5065b574eabb2c69f0578b9e311, user_id=9a9e704ff39d4d89a6f7841dc7a2278a, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.732962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:46.750626 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1340/2688] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:46 2021] PUT /identity/v3/projects/feafc5065b574eabb2c69f0578b9e311/users/9a9e704ff39d4d89a6f7841dc7a2278a/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:46.763393 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.763588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.763952 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.793549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] MFA Rules not processed for user `9a9e704ff39d4d89a6f7841dc7a2278a`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:46.794851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:46.871921 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1349/2689] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:46.876545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:46.959969 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7482a5-e22d-46cc-a447-c95695e967ce admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:46.966263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:46.966993 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:46.967279 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:46.967555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:46.968293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:46.970232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.003470 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1341/2690] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:46 2021] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:47.007870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.019976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683e52f-64e2-48fd-9a3f-ebfc96c2ad8c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.093823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.094536 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.094821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.095106 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.095833 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.097828 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.123281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1350/2691] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:47 2021] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:47.124702 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.137750 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e9be-cbce-4b87-82a4-63067b628360 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.146273 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.147011 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.147302 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.147583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.148338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.150019 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.164093 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1342/2692] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:47.169112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.180039 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab75a8b-c41a-4f05-b8d2-ccfc5155a005 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.186386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.187430 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.187614 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.187895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] PATH_INFO: `/v3/projects/87839523a94a484ebde893fd9e096e5d/users/c19bc707a978423cbcf7f656478671c4/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.208639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87839523a94a484ebde893fd9e096e5d, user_id=c19bc707a978423cbcf7f656478671c4, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.211648 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.233408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1351/2693] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:47 2021] PUT /identity/v3/projects/87839523a94a484ebde893fd9e096e5d/users/c19bc707a978423cbcf7f656478671c4/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:47.234907 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.245766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926b25-f3bb-4542-bdee-7dd90da418f5 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.311138 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.312040 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.312374 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.312839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.313553 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.315364 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19affba7-cf69-45a0-bc5f-c832a6f74a35 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.328494 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1343/2694] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:47 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:47.332153 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.345449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61d936-9490-4ba3-8d42-6db5f815ff03 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.350594 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.351499 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.351784 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.352064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] PATH_INFO: `/v3/projects/87839523a94a484ebde893fd9e096e5d/users/c19bc707a978423cbcf7f656478671c4/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.354266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=87839523a94a484ebde893fd9e096e5d, user_id=c19bc707a978423cbcf7f656478671c4, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.357075 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.370205 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1352/2695] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:47 2021] PUT /identity/v3/projects/87839523a94a484ebde893fd9e096e5d/users/c19bc707a978423cbcf7f656478671c4/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:47.381180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.381453 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.381728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.414070 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] MFA Rules not processed for user `c19bc707a978423cbcf7f656478671c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:47.415316 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:47.495186 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1344/2696] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:47 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:47.505988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:47.507919 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:47.568133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc0aa-7d50-4cd4-8b1c-a3b8f46bd1fe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:47.571895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:47.572549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:47.572832 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:47.573128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:47.634015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:47.635589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb80834-5aae-4223-b651-aad3a684f0fa service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:47.645319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1353/2697] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:47 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:50.215532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:50.285579 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802356-2b43-4b71-aeb3-b0cf21d541d8 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:50.299404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:50.300417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:50.300710 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:50.300986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] PATH_INFO: `/v3/users/9a9e704ff39d4d89a6f7841dc7a2278a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:50.302756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9e704ff39d4d89a6f7841dc7a2278a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:50.304814 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:50.360720 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9e704ff39d4d89a6f7841dc7a2278a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:50.361419 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9e704ff39d4d89a6f7841dc7a2278a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:50.368881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9e704ff39d4d89a6f7841dc7a2278a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:50.381532 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9e704ff39d4d89a6f7841dc7a2278a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:50.390226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9e704ff39d4d89a6f7841dc7a2278a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:50.397434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1345/2698] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:50 2021] DELETE /identity/v3/users/9a9e704ff39d4d89a6f7841dc7a2278a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:50.402066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:50.403141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:50.403299 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:50.423843 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:50.425097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:50.493197 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1354/2699] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:50.504247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:50.505979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:50.568649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea5852-b643-45a8-89ca-4d3025f0a528 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:50.572509 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:50.573180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:50.573466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:50.573747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:50.584275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:50.586195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:50.597658 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1346/2700] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:50.931807 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:50.934718 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:50.950462 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec81f6-d2f0-4f0a-a8ec-0f00b2d610ca None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:50.955746 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:50.957631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:50.957925 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:50.958252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] PATH_INFO: `/v3/projects/feafc5065b574eabb2c69f0578b9e311` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:50.959494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] RBAC: Authorizing `identity:delete_project(project_id=feafc5065b574eabb2c69f0578b9e311)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:50.962051 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:51.019304 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feafc5065b574eabb2c69f0578b9e311', 'request_id': 'req-4d470d31-990e-40a2-bab9-20e5a873637d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.024649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feafc5065b574eabb2c69f0578b9e311', 'request_id': 'req-4d470d31-990e-40a2-bab9-20e5a873637d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.032477 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feafc5065b574eabb2c69f0578b9e311', 'request_id': 'req-4d470d31-990e-40a2-bab9-20e5a873637d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.046488 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] The token cache is being invalidate because project feafc5065b574eabb2c69f0578b9e311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:51.046762 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.047416 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.049272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1355/2701] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:50 2021] DELETE /identity/v3/projects/feafc5065b574eabb2c69f0578b9e311 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:51.054242 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:51.066388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208ca0-5f5a-41fe-9f57-3acd0e0911ee service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:51.142578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:51.143471 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.143795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.144074 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] PATH_INFO: `/v3/users/c19bc707a978423cbcf7f656478671c4` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.145556 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19bc707a978423cbcf7f656478671c4)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:51.147406 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:51.204918 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19bc707a978423cbcf7f656478671c4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.205663 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19bc707a978423cbcf7f656478671c4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.213454 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19bc707a978423cbcf7f656478671c4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.226756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19bc707a978423cbcf7f656478671c4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.236982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-c38e3c47-f3e4-4cb8-8fbf-316d24af39b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19bc707a978423cbcf7f656478671c4'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.243195 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1347/2702] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:51:51 2021] DELETE /identity/v3/users/c19bc707a978423cbcf7f656478671c4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:51.541759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:51.543891 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:51.557991 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470d31-990e-40a2-bab9-20e5a873637d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:51.620517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:51.622189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.622479 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.622783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] PATH_INFO: `/v3/projects/87839523a94a484ebde893fd9e096e5d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.624971 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=87839523a94a484ebde893fd9e096e5d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:51.626987 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:51.678277 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87839523a94a484ebde893fd9e096e5d', 'request_id': 'req-ff2c20b6-18c0-4b1a-a778-182e994d24ff'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.683574 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87839523a94a484ebde893fd9e096e5d', 'request_id': 'req-ff2c20b6-18c0-4b1a-a778-182e994d24ff'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.689953 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87839523a94a484ebde893fd9e096e5d', 'request_id': 'req-ff2c20b6-18c0-4b1a-a778-182e994d24ff'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.702887 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] The token cache is being invalidate because project 87839523a94a484ebde893fd9e096e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:51:51.703750 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.704237 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-ff2c20b6-18c0-4b1a-a778-182e994d24ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:51:51.705756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1356/2703] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:51:51 2021] DELETE /identity/v3/projects/87839523a94a484ebde893fd9e096e5d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:51.711774 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.712067 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.712363 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.732145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:51.733444 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:51.806179 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1348/2704] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:51.816519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.816808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.817104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.838679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:51.840439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:51.849013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1357/2705] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:51.853485 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:51.865174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f24b6a-b6ff-4492-80a9-a7c2b7b19b3f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:51.870289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:51.871057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.871314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.871601 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.872369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:51:51.872679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:51.874314 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:51.887758 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1349/2706] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:51:51.894413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:51.906125 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d20c-f87b-4028-889b-4da8a1672b2c None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:51.912042 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:51.912741 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:51.913029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:51.913315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:51.914074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:51.916140 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:51.945663 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1358/2707] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:51 2021] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:51.949892 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:51.960101 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5de35-8b71-4b34-bdbe-629358f4f6b7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.040602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.041713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.042131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.042594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.044728 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.047334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.072009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1350/2708] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:51 2021] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:52.077779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.089408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424ae34-6e5b-4dbf-a46c-cbca5c2a3d9d admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.096077 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.099022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.099411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.099695 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.100500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.102159 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.113548 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1359/2709] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:52.118271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.130604 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e5c5-fefd-46da-865d-07b8b2f4f1ca admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.136145 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.137625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.138996 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.139371 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.140346 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.142221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c577f-6152-4d1a-95bf-f33dcb4a06da admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.154561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1351/2710] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:52.158922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.169595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae9c8d-f26e-4f50-a269-19ac0b52500a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.175726 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.176619 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.177030 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.177315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] PATH_INFO: `/v3/projects/548ce32d6da0483b876edb2c8f570e26/users/ea1d65fc8ee44679aab26f8f34d258dc/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.203156 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=548ce32d6da0483b876edb2c8f570e26, user_id=ea1d65fc8ee44679aab26f8f34d258dc, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.206532 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.229547 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1360/2711] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:52 2021] PUT /identity/v3/projects/548ce32d6da0483b876edb2c8f570e26/users/ea1d65fc8ee44679aab26f8f34d258dc/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:52.241682 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.242347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.242347 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.278432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] MFA Rules not processed for user `ea1d65fc8ee44679aab26f8f34d258dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:52.279715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:52.364695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1352/2712] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:52.370626 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.438328 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ff10-6a6d-4d62-bb2f-c8459fd0b28a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.444145 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.444819 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.445094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.445369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.446115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.448062 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.479097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1361/2713] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:52.483793 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.495020 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520050-4358-46e2-a16e-a721062b86c4 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.567038 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.567742 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.568187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.568368 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.569009 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.570980 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.595691 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1353/2714] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:51:52.600874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.613152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d9fa9-5996-4d4b-b38c-aa23742aed57 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.618537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.619208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.619493 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.619770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.620522 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.623569 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.634717 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1362/2715] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:52.640360 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.653584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8e5e-eb31-4a49-a549-1d169ad3bacd admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.658636 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.659337 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.659625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.659905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.660649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.662258 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b1cbb-8b46-4e8f-b373-7dc58a59ca5a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.672979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1354/2716] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:52.678723 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.691152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d45fb-741c-4878-b92b-d33d79f15c25 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.695959 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.696845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.697131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.697411 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] PATH_INFO: `/v3/projects/bbf38e18b94349098cbc3f15a509083a/users/24d611f6c27d41a494dce1cb21015614/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.719753 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf38e18b94349098cbc3f15a509083a, user_id=24d611f6c27d41a494dce1cb21015614, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.722470 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.740618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1363/2717] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:52 2021] PUT /identity/v3/projects/bbf38e18b94349098cbc3f15a509083a/users/24d611f6c27d41a494dce1cb21015614/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:51:52.753259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.753704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.753992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.786229 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] MFA Rules not processed for user `24d611f6c27d41a494dce1cb21015614`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:52.787588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:52.865029 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1355/2718] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:51:52.869729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:52.940893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca2ac-0974-40f4-835a-9b4fc96e8dc0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:52.946161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:52.946826 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:52.947097 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:52.947377 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:52.948102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:52.950616 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:52.979095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1364/2719] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:52.983628 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.000830 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ea894-6a60-44b7-a14d-7522b4623231 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.086060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.087172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.087498 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.087822 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.088581 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.091930 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.117384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1356/2720] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:51:52 2021] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:51:53.122554 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.133577 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5f45-91e2-450b-8224-4a09f87d879f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.139900 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.140567 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.141043 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.141458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.142429 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.144124 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.158865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1365/2721] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:51:53.163343 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.173735 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a591be-8483-4278-bf9f-44716995239e admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.178772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.179683 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.179962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.180244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] PATH_INFO: `/v3/projects/a287a7accc4d459c85131b9e9a8c12c0/users/0c08915b4fc848ca9c5a21cbbd9e39e7/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.209183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a287a7accc4d459c85131b9e9a8c12c0, user_id=0c08915b4fc848ca9c5a21cbbd9e39e7, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.212281 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.227146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1357/2722] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:53 2021] PUT /identity/v3/projects/a287a7accc4d459c85131b9e9a8c12c0/users/0c08915b4fc848ca9c5a21cbbd9e39e7/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:53.231795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.243049 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92bf76-5f85-4ae3-80af-fb9dbbc8a22b admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.313222 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.313899 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.314180 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.314464 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.315256 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.316873 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b87e3-a205-4ef6-96f4-f1e1cd4f1e42 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.328818 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1366/2723] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:51:53 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:51:53.333582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.347197 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee45-d3fa-4c1a-aa24-9b9a416ee2c7 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.353248 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.354244 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.354588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.354871 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] PATH_INFO: `/v3/projects/a287a7accc4d459c85131b9e9a8c12c0/users/0c08915b4fc848ca9c5a21cbbd9e39e7/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.357520 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a287a7accc4d459c85131b9e9a8c12c0, user_id=0c08915b4fc848ca9c5a21cbbd9e39e7, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.360334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.376014 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1358/2724] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:51:53 2021] PUT /identity/v3/projects/a287a7accc4d459c85131b9e9a8c12c0/users/0c08915b4fc848ca9c5a21cbbd9e39e7/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:51:53.393308 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.393589 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.393870 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.424888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] MFA Rules not processed for user `0c08915b4fc848ca9c5a21cbbd9e39e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:51:53.429133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:53.522770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1367/2725] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:51:53 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:51:53.534434 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:53.536445 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:51:53.604069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe13ab4-7621-41d6-920a-6870e6884029 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:53.610563 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:53.611594 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:53.612065 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:53.612586 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:53.707039 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:53.709970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:53.726763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1359/2726] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:53 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:55.329082 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:55.339563 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b9f89-13e9-41fc-81e1-9131eb6d6006 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:55.344434 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:55.345116 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:55.345396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:55.345771 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:55.421011 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:55.422673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:55.433349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1368/2727] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:55 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:51:56.053799 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:51:56.063985 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ec46-475a-4f0f-ad40-68f3ec47b835 service cinder] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:51:56.067922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:51:56.068578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:51:56.068880 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:51:56.069163 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:51:56.080872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:51:56.083618 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce4130-0838-4ca9-922a-de085140d631 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:51:56.097564 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1360/2728] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:51:56 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:01.204665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:01.308578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3433143-55c6-4a44-8497-a685ddb24ac2 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:01.316509 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:01.317854 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:01.318292 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:01.318627 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] PATH_INFO: `/v3/users/ea1d65fc8ee44679aab26f8f34d258dc` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:01.320729 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1d65fc8ee44679aab26f8f34d258dc)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:01.325040 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:01.381413 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1d65fc8ee44679aab26f8f34d258dc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:01.382164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1d65fc8ee44679aab26f8f34d258dc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:01.382902 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1d65fc8ee44679aab26f8f34d258dc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:01.402210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1d65fc8ee44679aab26f8f34d258dc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:01.410770 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1d65fc8ee44679aab26f8f34d258dc'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:01.423233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1369/2729] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:52:01 2021] DELETE /identity/v3/users/ea1d65fc8ee44679aab26f8f34d258dc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:52:01.427896 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:01.428416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:01.428519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:01.448285 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:01.450489 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:01.516792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1361/2730] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:52:01.526964 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:01.528559 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:01.590091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad854c-d2cf-41fc-bd46-29e200543d1e admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:01.594320 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:01.595093 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:01.595420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:01.595699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:01.606679 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:01.608152 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:01.622893 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1370/2731] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:52:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:01.913744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:01.915332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:01.931021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2f413-fabb-454f-8db0-add0ab76cc61 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:01.938813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:01.939708 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:01.940016 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:01.940290 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] PATH_INFO: `/v3/projects/548ce32d6da0483b876edb2c8f570e26` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:01.941656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548ce32d6da0483b876edb2c8f570e26)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:01.943575 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:02.003052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548ce32d6da0483b876edb2c8f570e26', 'request_id': 'req-9704d0dd-b61d-45e9-a6fe-495e792cde25'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.009780 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548ce32d6da0483b876edb2c8f570e26', 'request_id': 'req-9704d0dd-b61d-45e9-a6fe-495e792cde25'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.015654 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548ce32d6da0483b876edb2c8f570e26', 'request_id': 'req-9704d0dd-b61d-45e9-a6fe-495e792cde25'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.029915 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] The token cache is being invalidate because project 548ce32d6da0483b876edb2c8f570e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:52:02.030209 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.030970 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.032647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1362/2732] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:52:01 2021] DELETE /identity/v3/projects/548ce32d6da0483b876edb2c8f570e26 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:02.037396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:02.049668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f608-943b-46a7-8256-3e777e56e218 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:02.113285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:02.114171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:02.114460 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:02.114797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] PATH_INFO: `/v3/users/24d611f6c27d41a494dce1cb21015614` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:02.116162 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d611f6c27d41a494dce1cb21015614)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:02.118109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:02.171797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d611f6c27d41a494dce1cb21015614'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.172432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d611f6c27d41a494dce1cb21015614'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.173033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d611f6c27d41a494dce1cb21015614'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.187251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d611f6c27d41a494dce1cb21015614'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.195142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d611f6c27d41a494dce1cb21015614'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.208885 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1371/2733] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:52:02 2021] DELETE /identity/v3/users/24d611f6c27d41a494dce1cb21015614 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:02.538235 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:02.541057 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:02.557690 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704d0dd-b61d-45e9-a6fe-495e792cde25 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:02.635338 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:02.636207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:02.636497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:02.637276 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] PATH_INFO: `/v3/projects/bbf38e18b94349098cbc3f15a509083a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:02.639137 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf38e18b94349098cbc3f15a509083a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:02.641045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:02.688680 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf38e18b94349098cbc3f15a509083a', 'request_id': 'req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.694816 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf38e18b94349098cbc3f15a509083a', 'request_id': 'req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.702187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf38e18b94349098cbc3f15a509083a', 'request_id': 'req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.716945 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] The token cache is being invalidate because project bbf38e18b94349098cbc3f15a509083a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:52:02.717227 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.718035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.719657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1363/2734] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:52:02 2021] DELETE /identity/v3/projects/bbf38e18b94349098cbc3f15a509083a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:02.724356 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:02.726169 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:02.744184 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae97412-3619-4330-a4a0-c9bbb404f19f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:02.807742 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:02.808857 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:02.809109 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:02.809240 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] PATH_INFO: `/v3/users/0c08915b4fc848ca9c5a21cbbd9e39e7` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:02.810489 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c08915b4fc848ca9c5a21cbbd9e39e7)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:02.812587 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:02.872132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c08915b4fc848ca9c5a21cbbd9e39e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.872961 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c08915b4fc848ca9c5a21cbbd9e39e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.873624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c08915b4fc848ca9c5a21cbbd9e39e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.889313 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c08915b4fc848ca9c5a21cbbd9e39e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.900113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-a6983537-8f26-4c39-ba63-3e3232a4b8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c08915b4fc848ca9c5a21cbbd9e39e7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:02.914799 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1372/2735] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:52:02 2021] DELETE /identity/v3/users/0c08915b4fc848ca9c5a21cbbd9e39e7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:03.266130 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.269506 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:03.286400 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb1e6b-65cd-462c-83d9-fac94e0dca1a admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.377679 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.378609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.378894 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.379175 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] PATH_INFO: `/v3/projects/a287a7accc4d459c85131b9e9a8c12c0` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.380461 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a287a7accc4d459c85131b9e9a8c12c0)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.382403 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.448620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a287a7accc4d459c85131b9e9a8c12c0', 'request_id': 'req-ea3252d4-800c-48d1-8f00-c67f7f0148d8'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:03.455513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a287a7accc4d459c85131b9e9a8c12c0', 'request_id': 'req-ea3252d4-800c-48d1-8f00-c67f7f0148d8'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:03.461592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a287a7accc4d459c85131b9e9a8c12c0', 'request_id': 'req-ea3252d4-800c-48d1-8f00-c67f7f0148d8'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:03.474540 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] The token cache is being invalidate because project a287a7accc4d459c85131b9e9a8c12c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:52:03.474839 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:03.475492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-ea3252d4-800c-48d1-8f00-c67f7f0148d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:03.477053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1364/2736] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:52:03 2021] DELETE /identity/v3/projects/a287a7accc4d459c85131b9e9a8c12c0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:03.483874 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.484458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.484458 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.506432 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:03.507737 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:03.572033 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1373/2737] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:52:03.580643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91e18-ca8f-480e-903b-118198872943 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.581255 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91e18-ca8f-480e-903b-118198872943 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.581411 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e91e18-ca8f-480e-903b-118198872943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.601386 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-87e91e18-ca8f-480e-903b-118198872943 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:03.602651 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-87e91e18-ca8f-480e-903b-118198872943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:03.611727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1365/2738] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:03.616234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.627001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e7534-c17b-44f9-bf20-f5a440dda551 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.631860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.632524 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.632802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.633072 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] PATH_INFO: `/v3/domains` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.633825 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79640) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:52:03.634131 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.636012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.656266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1374/2739] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:52:03.660927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e91e18-ca8f-480e-903b-118198872943 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.671228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e91e18-ca8f-480e-903b-118198872943 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.676060 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.676732 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.677012 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.677284 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.677992 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.679929 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.714369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1366/2740] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:52:03 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:52:03.720096 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.733984 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5467f3-32b9-43e3-b00b-3d9cfb422901 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.824398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.825550 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.825889 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.826376 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] PATH_INFO: `/v3/users` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.827332 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.829298 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.852992 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1375/2741] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:52:03 2021] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:52:03.858548 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.870013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30f14f-94ae-49c8-83a5-6ca02b5dcc64 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.875766 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.876443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.876727 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.876999 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.877751 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.879385 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.891259 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1367/2742] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:52:03.895603 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.907981 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17570a6-c20b-4abc-8bf7-fd23e87f9bae admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.914101 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.915176 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.915659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.916148 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.917510 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.920954 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dcac1-2fa9-4df6-93db-585578491acc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:03.938330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1376/2743] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:03 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:52:03.944404 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:03.958870 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243f80-c5ae-4c10-97fb-0fa4c2b1a689 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:03.964528 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:03.965459 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:03.965957 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:03.966583 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] PATH_INFO: `/v3/projects/fca1fcaaa64943c588c2963490ef2fe9/users/186f031d59c648179182421732afb9ca/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:03.982247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca1fcaaa64943c588c2963490ef2fe9, user_id=186f031d59c648179182421732afb9ca, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:03.984977 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:04.000024 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1368/2744] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:52:03 2021] PUT /identity/v3/projects/fca1fcaaa64943c588c2963490ef2fe9/users/186f031d59c648179182421732afb9ca/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:04.011412 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddda63-5ba6-4482-9d0c-d5695f0d36ff None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:04.011698 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddda63-5ba6-4482-9d0c-d5695f0d36ff None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:04.012905 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddda63-5ba6-4482-9d0c-d5695f0d36ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:04.044999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-acddda63-5ba6-4482-9d0c-d5695f0d36ff None None] MFA Rules not processed for user `186f031d59c648179182421732afb9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:04.046258 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-acddda63-5ba6-4482-9d0c-d5695f0d36ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:04.117863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1377/2745] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:04 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:04.129921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:04.131741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:04.194986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d51e16-ecaf-4c15-a065-04b513f558c3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:04.198968 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:04.199792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:04.199925 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:04.200182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:04.209831 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:04.211625 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2181804-113b-4cb2-aeeb-9dc5dc122f52 service cinder] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:04.221415 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1369/2746] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:52:04 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:05.630272 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:05.630932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:05.630932 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:05.650622 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] MFA Rules not processed for user `186f031d59c648179182421732afb9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:05.652027 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:05.662141 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1378/2747] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:05 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:32.881469 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80f79-4b57-4a0d-ac2a-16d8ec87fc51 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:32.882295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80f79-4b57-4a0d-ac2a-16d8ec87fc51 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:32.882465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80f79-4b57-4a0d-ac2a-16d8ec87fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:32.904573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-b6e80f79-4b57-4a0d-ac2a-16d8ec87fc51 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:32.905882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-b6e80f79-4b57-4a0d-ac2a-16d8ec87fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:32.989122 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1370/2748] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:52:32 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:33.042447 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:33.045303 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:33.138439 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec5ff6-06cc-4f2b-b36a-dd0b0219612f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:33.143703 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:33.144291 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:33.144578 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:33.144865 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:33.154631 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:33.156252 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:33.165422 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1379/2749] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:52:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:33.804213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b281-19fa-4aa6-a764-fefa0c35d262 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:33.804499 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b281-19fa-4aa6-a764-fefa0c35d262 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:33.804775 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b281-19fa-4aa6-a764-fefa0c35d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:33.826635 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-3af3b281-19fa-4aa6-a764-fefa0c35d262 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:33.827881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3af3b281-19fa-4aa6-a764-fefa0c35d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:33.835462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1371/2750] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:52:33 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:33.848721 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:33.859595 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acc389-4bb5-479b-a984-f28db28bd9a6 service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:33.865092 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:33.865773 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:33.866059 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:33.866337 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:33.876199 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:33.877813 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:33.887138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1380/2751] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:52:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 08:52:34.289786 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:34.290380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:34.290534 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:34.311267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:34.312569 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:34.320545 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1372/2752] 10.222.0.76 () {58 vars in 967 bytes} [Thu Oct 28 08:52:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:34.338629 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:34.351896 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e373-7458-412a-b9d3-b0a07d6794bf service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:34.364018 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:34.365546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:34.366025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:34.366309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:34.376802 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:34.378690 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bafeb7-b527-4f0a-8fe1-52032bc9501a service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:34.394646 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1381/2753] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:52:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:36.459736 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:36.521938 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62461f-6bd1-497d-b395-858631f1e221 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:36.526580 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:36.527477 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:36.527747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:36.528027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] PATH_INFO: `/v3/users/186f031d59c648179182421732afb9ca` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:36.529275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186f031d59c648179182421732afb9ca)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:36.531247 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:36.579657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186f031d59c648179182421732afb9ca'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:36.580304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186f031d59c648179182421732afb9ca'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:36.587437 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186f031d59c648179182421732afb9ca'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:36.599326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186f031d59c648179182421732afb9ca'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:36.608495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186f031d59c648179182421732afb9ca'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:36.614765 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1373/2754] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:52:36 2021] DELETE /identity/v3/users/186f031d59c648179182421732afb9ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:36.619507 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:36.620064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:36.620064 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:36.639387 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:36.640612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:36.702053 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1382/2755] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:52:36.712249 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:36.713689 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:36.776095 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb40b4-ca18-4376-9f48-a2e173f69a04 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:36.780927 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:36.781596 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:36.781886 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:36.782196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:36.792282 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:36.793887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e1fb6-f114-450a-8234-2d4364bf870c service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:36.810096 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1374/2756] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:52:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:37.045934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.047667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:37.060655 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b462c-dfdd-4576-9987-44be001f7eef None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.065701 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.066688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.066895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.067219 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] PATH_INFO: `/v3/projects/fca1fcaaa64943c588c2963490ef2fe9` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.068702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca1fcaaa64943c588c2963490ef2fe9)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.070739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.122659 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca1fcaaa64943c588c2963490ef2fe9', 'request_id': 'req-51057013-c4e5-40ef-abdf-4e5add23923e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:37.129525 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca1fcaaa64943c588c2963490ef2fe9', 'request_id': 'req-51057013-c4e5-40ef-abdf-4e5add23923e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:37.137494 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca1fcaaa64943c588c2963490ef2fe9', 'request_id': 'req-51057013-c4e5-40ef-abdf-4e5add23923e'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:37.153562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] The token cache is being invalidate because project fca1fcaaa64943c588c2963490ef2fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:52:37.153861 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:37.154527 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-51057013-c4e5-40ef-abdf-4e5add23923e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:52:37.156087 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1383/2757] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:52:37 2021] DELETE /identity/v3/projects/fca1fcaaa64943c588c2963490ef2fe9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:37.162237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.162555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.162922 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.181763 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:37.183021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:37.248196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1375/2758] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:37.256552 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.256846 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.257130 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.276241 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:37.277644 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:37.286060 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1384/2759] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:37.290407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.301171 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd398e0-2f09-41c8-9182-493b9988a084 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.307134 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.308021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.308232 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.308574 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.309181 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:52:37.309496 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.311207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.329608 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1376/2760] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:52:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:52:37.334789 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.347448 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41119d40-f251-43a1-b62e-5048a29bde4f None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.352210 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.352868 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.353267 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.353407 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.354113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.357229 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.383557 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1385/2761] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:52:37 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:52:37.388165 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.398782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9add5-0170-45f9-8c17-404c9284e4d2 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.461504 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.462213 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.462460 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.462777 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.463519 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.466152 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.488869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1377/2762] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:52:37 2021] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:52:37.492977 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.504057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6312c-3178-47a4-8cc9-7c016215a05a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.509189 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.509853 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.510142 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.510443 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.511213 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.512839 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.523618 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1386/2763] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:52:37.528380 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.539225 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6cdb-d1f8-41c9-a705-725b5ca4153b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.545001 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.545931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.546300 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.546678 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.547438 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.549045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff9933-c53d-45b9-892a-0d6050361a7a admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.559554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1378/2764] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:52:37.563888 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.574054 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4c769-34f6-4d15-95f6-14d85bc276b3 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.579143 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.580026 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.580309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.580586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] PATH_INFO: `/v3/projects/a64a3a87a40249f8993dee5bc1950484/users/1d00d9bbd6f1477eb0998236b921007e/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.597196 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64a3a87a40249f8993dee5bc1950484, user_id=1d00d9bbd6f1477eb0998236b921007e, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.599975 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.614333 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1387/2765] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:52:37 2021] PUT /identity/v3/projects/a64a3a87a40249f8993dee5bc1950484/users/1d00d9bbd6f1477eb0998236b921007e/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:52:37.619614 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930a21-ac84-4f2b-b2f5-0dc07ab107e0 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.619910 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930a21-ac84-4f2b-b2f5-0dc07ab107e0 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.620194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0930a21-ac84-4f2b-b2f5-0dc07ab107e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.639904 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-c0930a21-ac84-4f2b-b2f5-0dc07ab107e0 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:37.641157 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-c0930a21-ac84-4f2b-b2f5-0dc07ab107e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:37.703133 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1379/2766] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:37.713375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:37.715922 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:37.784334 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f98de9-5ec5-48ea-8d18-189c5af65ce6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:37.788094 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:37.788775 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:37.789066 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:37.789349 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:37.800019 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:37.801500 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:37.813113 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1388/2767] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:52:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:42.574146 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:42.574782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:42.574782 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:42.604749 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] MFA Rules not processed for user `1d00d9bbd6f1477eb0998236b921007e`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:42.606301 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:42.690310 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1380/2768] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:42 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:42.691566 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:42.704322 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a85cd-52aa-45eb-a6cc-d326f883c6f6 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:42.710091 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:42.710800 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:42.711862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:42.711862 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:42.712312 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:42.714371 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:42.750453 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1389/2769] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:52:42 2021] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:52:42.755372 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:42.769271 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da078e18-e6e7-4393-88ed-72b5c18bed09 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:42.857305 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:42.858317 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:42.858845 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:42.859303 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:42.860094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:42.862951 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:42.894329 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1381/2770] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:52:42 2021] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:52:42.899331 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:42.916716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8862d9-1a6e-4ba5-9d94-ea526f4221fc admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:42.926396 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:42.927572 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:42.928006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:42.928491 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:42.929821 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:42.933512 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:42.952182 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1390/2771] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 08:52:42.967464 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:42.980935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd59-11d0-4421-a4bf-643b021f4790 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:42.989221 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:42.990086 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:42.990426 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:42.991318 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] PATH_INFO: `/v3/projects/f5adad766f6c46a9aecb882bde59675d/users/b99aca882e1c4a2a8e882447fdc15e4d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:43.014988 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5adad766f6c46a9aecb882bde59675d, user_id=b99aca882e1c4a2a8e882447fdc15e4d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:43.019238 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:43.040546 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1382/2772] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:52:42 2021] PUT /identity/v3/projects/f5adad766f6c46a9aecb882bde59675d/users/b99aca882e1c4a2a8e882447fdc15e4d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:43.052302 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:43.070999 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51062e2-a0e9-46d8-9be0-86af895a3976 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:43.186283 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:43.187405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:43.187740 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:43.188171 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:43.189028 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:43.190711 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b6194-7bb1-408f-a46b-435d890e4741 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:43.216198 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1391/2773] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:52:43 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:52:43.220187 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:43.233202 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107368-1407-4893-8dd2-cf282328da5b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:43.239815 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:43.240740 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:43.241025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:43.241479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] PATH_INFO: `/v3/projects/f5adad766f6c46a9aecb882bde59675d/users/b99aca882e1c4a2a8e882447fdc15e4d/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:43.243660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5adad766f6c46a9aecb882bde59675d, user_id=b99aca882e1c4a2a8e882447fdc15e4d, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:43.248177 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:43.265533 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1383/2774] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:52:43 2021] PUT /identity/v3/projects/f5adad766f6c46a9aecb882bde59675d/users/b99aca882e1c4a2a8e882447fdc15e4d/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:52:48.926406 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5972-6af6-40cb-a812-fcfd591e80c7 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:48.927203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5972-6af6-40cb-a812-fcfd591e80c7 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:48.927203 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5972-6af6-40cb-a812-fcfd591e80c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:48.975837 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-944e5972-6af6-40cb-a812-fcfd591e80c7 None None] MFA Rules not processed for user `b99aca882e1c4a2a8e882447fdc15e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:48.980035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-944e5972-6af6-40cb-a812-fcfd591e80c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:49.100266 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1392/2775] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:48 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:52:49.114222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:49.116052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:49.217982 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d48f0-0b8e-4f40-98e5-725c9c653f0c admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:49.222118 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97167b82c21643c08543bf5d6323c599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:49.222829 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:49.223098 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:49.223440 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:49.310773 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:49.312527 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:49.323643 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1384/2776] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:52:49 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:52:49.453693 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72ded-a758-493f-b967-90dd7171dc38 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:49.454107 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72ded-a758-493f-b967-90dd7171dc38 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:49.454628 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d72ded-a758-493f-b967-90dd7171dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:49.476845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-b2d72ded-a758-493f-b967-90dd7171dc38 None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:49.478235 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b2d72ded-a758-493f-b967-90dd7171dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:49.551710 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1393/2777] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:52:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:52:49.567882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:52:49.569322 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:49.679027 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4db15-a147-4087-834e-96a7165152e0 service glance] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:52:49.688333 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:52:49.689539 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:49.690069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:49.690592 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:49.705180 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:52:49.708328 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1470eaa-f640-4223-b3f2-fb288466c324 service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:52:49.722388 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1385/2778] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:52:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:52:50.335216 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:52:50.338598 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:52:50.339806 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:52:50.374749 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] MFA Rules not processed for user `1ca3422951ef4ccc8f40838ba2532bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:52:50.377275 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:52:50.540555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1394/2779] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:52:50 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:53:02.306115 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:02.306724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:02.306826 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:02.326192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] MFA Rules not processed for user `1d00d9bbd6f1477eb0998236b921007e`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:53:02.327745 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:02.336384 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1386/2780] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:53:02 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:53:02.685797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:53:02.687375 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:02.782466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75018338-f999-4482-88c2-3802a9ba0839 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:53:02.786794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:53:02.787459 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:02.787739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:02.788013 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:02.790014 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:02.805456 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:53:02.806988 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804a408-5a27-4cbf-a324-d893a6310570 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:53:02.817122 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1395/2781] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:53:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:53:03.764010 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:53:03.765416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:03.866226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94087c1-f837-4e33-ae9a-8784c86fae43 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:53:03.872747 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:53:03.873392 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:03.873731 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:03.873937 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:03.876013 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:03.888833 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:53:03.890451 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:53:03.902178 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1387/2782] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:53:03 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:53:04.932625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:04.933254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:04.933254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:04.984325 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:53:04.986119 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:53:05.004105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1396/2783] 10.222.0.76 () {58 vars in 1009 bytes} [Thu Oct 28 08:53:04 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:53:05.019538 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:53:05.032645 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8c740-099d-4a5e-95e8-fb0704b126b4 service placement] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:53:05.037695 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:53:05.038344 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:05.038662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:05.038926 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:05.048842 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:53:05.050772 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:53:05.059497 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1388/2784] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:53:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 08:53:45.206612 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:53:45.217012 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011012df-e635-4ac2-84b1-03d8e0c2fe4b None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:53:45.220702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:53:45.221355 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:53:45.221639 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:53:45.221923 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:53:45.235449 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:53:45.236909 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:53:45.248006 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1397/2785] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:53:45 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:54:15.599104 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:15.601578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:15.734326 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c3ba-bea6-4545-8787-1af28116c3b1 service swift] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:15.741657 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:15.743196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:15.743706 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:15.744211 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] PATH_INFO: `/v3/users/1ca3422951ef4ccc8f40838ba2532bbf` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:15.747761 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca3422951ef4ccc8f40838ba2532bbf)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:15.751557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:15.808684 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca3422951ef4ccc8f40838ba2532bbf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:15.809462 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca3422951ef4ccc8f40838ba2532bbf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:15.817859 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca3422951ef4ccc8f40838ba2532bbf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:15.830610 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca3422951ef4ccc8f40838ba2532bbf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:15.840275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-02a5f2d5-f9a5-46ac-b16f-e7ff2438aa06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca3422951ef4ccc8f40838ba2532bbf'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:15.849495 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1389/2786] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:54:15 2021] DELETE /identity/v3/users/1ca3422951ef4ccc8f40838ba2532bbf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:54:16.047942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.060115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4cf5b-65f2-40da-b2d0-3b8b1bbab481 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.132336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.133759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.134254 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.134805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] PATH_INFO: `/v3/projects/44c9c1891789491bbcae9bca7f8654f2` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.137015 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c9c1891789491bbcae9bca7f8654f2)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.139673 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.191497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c9c1891789491bbcae9bca7f8654f2', 'request_id': 'req-7394124c-46eb-498c-9af3-57e38da22d43'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:16.197519 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c9c1891789491bbcae9bca7f8654f2', 'request_id': 'req-7394124c-46eb-498c-9af3-57e38da22d43'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:16.205175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c9c1891789491bbcae9bca7f8654f2', 'request_id': 'req-7394124c-46eb-498c-9af3-57e38da22d43'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:16.222851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] The token cache is being invalidate because project 44c9c1891789491bbcae9bca7f8654f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:54:16.223146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:16.223745 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-7394124c-46eb-498c-9af3-57e38da22d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:54:16.225319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1398/2787] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:54:16 2021] DELETE /identity/v3/projects/44c9c1891789491bbcae9bca7f8654f2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:54:16.232837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.233129 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.233407 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.298450 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:16.299713 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:16.364021 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1390/2788] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:54:16.372048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.372340 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.372625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.393688 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:16.395761 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:16.405803 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1399/2789] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:54:16.410112 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.425805 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2f16f-c2e8-4ff7-b168-031f1dcca4f1 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.430483 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.431174 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.431466 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.431741 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] PATH_INFO: `/v3/domains` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.432882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 08:54:16.433222 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.434883 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.446621 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1391/2790] 10.222.0.76 () {58 vars in 1152 bytes} [Thu Oct 28 08:54:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 08:54:16.452795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.462273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6d12-52d1-44d1-85b1-f5bc3f794220 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.468314 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.468965 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.469247 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.469520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.470234 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.472146 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.499214 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1400/2791] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:54:16 2021] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:54:16.503468 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.515082 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b1a74-8e5b-459b-8e55-b007a36e166d admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.571080 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.571759 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.572043 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.572319 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.573582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.575584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.597296 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1392/2792] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:54:16 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:54:16.601318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.612336 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911dfa-15eb-436e-ba7d-2968b6c5222f admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.617341 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.618001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.618282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.618581 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.619408 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.621397 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.632354 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1401/2793] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:54:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:54:16.637293 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.647792 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0cc17-cf72-4d7a-89e5-47953eaabd2b admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.653289 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.654025 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.654311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.654617 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.655369 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.656979 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01488dd1-355c-44e5-b969-f552fc1083f0 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.667345 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1393/2794] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:54:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:54:16.671608 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.681426 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3617a21-f6a8-433e-a0ea-7670571c47f6 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.686183 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.687104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.687389 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.687665 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] PATH_INFO: `/v3/projects/623855e29a5d4365b1dc09eed95a5c8a/users/d2ef7b4e60214c6c9b5839e9ccfaad4d/roles/4dd88532ef744ea69be69bfd9975560b` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.703378 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623855e29a5d4365b1dc09eed95a5c8a, user_id=d2ef7b4e60214c6c9b5839e9ccfaad4d, role_id=4dd88532ef744ea69be69bfd9975560b)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.706029 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.720363 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1402/2795] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:54:16 2021] PUT /identity/v3/projects/623855e29a5d4365b1dc09eed95a5c8a/users/d2ef7b4e60214c6c9b5839e9ccfaad4d/roles/4dd88532ef744ea69be69bfd9975560b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:54:16.725493 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5253-f814-43f2-a594-b4837c2eb991 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.725784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5253-f814-43f2-a594-b4837c2eb991 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.726078 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea5253-f814-43f2-a594-b4837c2eb991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.744746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-52ea5253-f814-43f2-a594-b4837c2eb991 None None] MFA Rules not processed for user `caea61e355e24e9880292252c98a910d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:16.745972 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-52ea5253-f814-43f2-a594-b4837c2eb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:16.841192 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1394/2796] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:54:16.851085 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:16.852851 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:16.910248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886a8a-7109-4305-b591-56ae98b6cd58 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:16.913966 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:16.914649 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:16.914934 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:16.915208 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:16.924823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:16.926281 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:16.937166 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1403/2797] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:54:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:54:21.167336 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.167931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.167931 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.198813 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] MFA Rules not processed for user `d2ef7b4e60214c6c9b5839e9ccfaad4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:21.200076 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:21.272955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1395/2798] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:54:21.278930 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.289435 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a2be-addc-4596-ae69-2edcb8ec055c service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.295810 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.296506 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.296797 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.297078 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.297808 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.300583 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.336667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1404/2799] 10.222.0.76 () {60 vars in 1152 bytes} [Thu Oct 28 08:54:21 2021] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 08:54:21.337891 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.352632 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe914b4-7182-44c6-b8c0-5dcfe45d625e None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.426196 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.427094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.427522 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.427905 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.428704 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.430784 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.453035 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1396/2800] 10.222.0.76 () {60 vars in 1143 bytes} [Thu Oct 28 08:54:21 2021] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 08:54:21.457132 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.469455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db968f9-ca9b-4a44-81c2-70ba527e4d5a admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.474537 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.475217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.475497 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.475772 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.476515 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.478121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.490675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1405/2801] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:54:21.495267 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.505752 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e45fa-0a7b-4cc0-8696-66b5d8660cd9 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.526554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.526554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.526554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.526554 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] PATH_INFO: `/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e/users/fd3e43c02e3c40e0bfa57db2abdaddb7/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.549743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1b8cb4edc4f80b203ed71129ad96e, user_id=fd3e43c02e3c40e0bfa57db2abdaddb7, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.549743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.564478 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1397/2802] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:54:21 2021] PUT /identity/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e/users/fd3e43c02e3c40e0bfa57db2abdaddb7/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 08:54:21.568551 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.582820 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1969e27-27ee-454f-be24-142e290b52df admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.661989 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.662708 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.663001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.663285 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.664048 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.665682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b3e75-c8be-49ee-836e-be5137bba96a admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.680154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1406/2803] 10.222.0.76 () {58 vars in 1121 bytes} [Thu Oct 28 08:54:21 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 08:54:21.684535 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:21.695619 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6ac20-604d-4dbf-8a9c-cb98adc31acf admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:21.701602 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:21.702555 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:21.702921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:21.703106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] PATH_INFO: `/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e/users/fd3e43c02e3c40e0bfa57db2abdaddb7/roles/cd529a78508a4af5ae28fe4417bc6cae` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:21.705243 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae1b8cb4edc4f80b203ed71129ad96e, user_id=fd3e43c02e3c40e0bfa57db2abdaddb7, role_id=cd529a78508a4af5ae28fe4417bc6cae)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:21.708094 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:21.720756 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1398/2804] 10.222.0.76 () {60 vars in 1482 bytes} [Thu Oct 28 08:54:21 2021] PUT /identity/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e/users/fd3e43c02e3c40e0bfa57db2abdaddb7/roles/cd529a78508a4af5ae28fe4417bc6cae => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:54:26.952220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257a0c0-5771-40e3-bf32-69b4d2756b72 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:26.952759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257a0c0-5771-40e3-bf32-69b4d2756b72 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:26.952759 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257a0c0-5771-40e3-bf32-69b4d2756b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:26.980391 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-e257a0c0-5771-40e3-bf32-69b4d2756b72 None None] MFA Rules not processed for user `fd3e43c02e3c40e0bfa57db2abdaddb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:26.982249 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-e257a0c0-5771-40e3-bf32-69b4d2756b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:27.051823 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1407/2805] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:26 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 08:54:27.065004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:27.067515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:27.175007 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2b7d-4bec-4863-9fe6-8545f53bdc07 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:27.181412 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:27.183002 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:27.183304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:27.183587 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:27.250351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:27.253889 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:27.269819 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1399/2806] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:54:27 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:54:52.445667 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] REQUEST_METHOD: `POST` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:52.446253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:52.446253 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:52.465344 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.auth.core [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] MFA Rules not processed for user `d2ef7b4e60214c6c9b5839e9ccfaad4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79640) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:54:52.466678 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:52.473624 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1408/2807] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:54:52 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:54:55.472479 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:54:55.473838 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:55.546126 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56987fc-0f58-41bb-893a-efe4ab5efb46 service nova] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:54:55.550620 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:54:55.551320 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:54:55.551609 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:54:55.551903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:54:55.553790 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:54:55.572855 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:54:55.574584 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:54:55.587912 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1400/2808] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:54:55 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:55:04.370245 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:55:04.380495 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ee40f-c0da-4b4d-9d17-18bf870c1757 None None] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:55:04.384187 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:55:04.384845 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:55:04.385128 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:55:04.385409 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:55:04.387274 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:55:04.401452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:55:04.402938 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:55:04.414635 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1409/2809] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:55:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:55:10.068542 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:55:10.079332 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8ab3-c208-4fd3-ba6a-13cbe68c0d8b service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:55:10.083190 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:55:10.083847 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:55:10.084131 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:55:10.084408 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:55:10.094582 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:55:10.096110 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:55:10.106517 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1401/2810] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:55:10 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:55:11.793549 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:55:11.795739 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:55:11.818442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf25808-e4ee-4a81-96a9-d28d2753d524 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:55:11.827164 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:55:11.828010 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:55:11.828300 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:55:11.828588 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:55:11.830452 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:55:11.844484 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:55:11.846476 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:55:11.859074 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1410/2811] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:55:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:56:07.483881 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:07.493433 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8f1ab-a86b-444c-8af3-1aff1589dafb service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:07.497422 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:07.498071 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:07.498355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:07.498662 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:07.500557 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:07.512189 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:07.513622 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f5464-3275-4fb4-bb86-2bfb3fe4b5f8 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:07.521962 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1402/2812] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:56:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:56:18.279956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:18.294248 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741bdf-c285-416b-be7c-a2f167a4dc2d service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:18.307625 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:18.310895 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:18.311105 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:18.311431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:18.320403 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:18.340752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:18.342388 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:18.368584 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1411/2813] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:56:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:56:25.935887 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:25.936414 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:25.936513 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:25.993449 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] MFA Rules not processed for user `bfa6e1051d6d4779acc95a619cc9ee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:56:25.994744 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:26.064158 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1403/2814] 10.222.0.76 () {58 vars in 967 bytes} [Thu Oct 28 08:56:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:56:26.107431 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:26.108956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:26.202150 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ecdc-8050-45d0-949f-0c7d8517effc service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:26.207976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18cea006ecc24067ac542e3944ad7a9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:26.208674 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:26.208957 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:26.209233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:26.218675 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:26.220278 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:26.229454 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1412/2815] 10.222.0.76 () {60 vars in 1384 bytes} [Thu Oct 28 08:56:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 08:56:33.285311 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:33.286909 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:33.364045 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08085-d641-46a2-8301-27a5dec5c93f None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:33.368916 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:33.369795 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:33.370079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:33.370355 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] PATH_INFO: `/v3/users/1d00d9bbd6f1477eb0998236b921007e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:33.371630 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d00d9bbd6f1477eb0998236b921007e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:33.373567 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:33.422647 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d00d9bbd6f1477eb0998236b921007e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.423307 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d00d9bbd6f1477eb0998236b921007e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.431051 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d00d9bbd6f1477eb0998236b921007e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.442711 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d00d9bbd6f1477eb0998236b921007e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.452739 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d00d9bbd6f1477eb0998236b921007e'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.459724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1404/2816] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:56:33 2021] DELETE /identity/v3/users/1d00d9bbd6f1477eb0998236b921007e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:56:33.644517 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:33.657282 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f233e7-24e4-4dde-9851-608c0ea5f681 service swift] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:33.716779 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:33.717642 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:33.717924 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:33.718202 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] PATH_INFO: `/v3/projects/a64a3a87a40249f8993dee5bc1950484` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:33.719455 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64a3a87a40249f8993dee5bc1950484)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:33.721359 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:33.767738 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64a3a87a40249f8993dee5bc1950484', 'request_id': 'req-52b2053b-8e5b-4010-ab08-ffe571f3fe13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.773713 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64a3a87a40249f8993dee5bc1950484', 'request_id': 'req-52b2053b-8e5b-4010-ab08-ffe571f3fe13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.779926 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64a3a87a40249f8993dee5bc1950484', 'request_id': 'req-52b2053b-8e5b-4010-ab08-ffe571f3fe13'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.792863 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] The token cache is being invalidate because project a64a3a87a40249f8993dee5bc1950484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:56:33.793090 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.793794 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.795752 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1413/2817] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:56:33 2021] DELETE /identity/v3/projects/a64a3a87a40249f8993dee5bc1950484 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:56:33.799882 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:33.801561 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:33.816518 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803c93-18e6-4242-beb6-a8dc8f69b3f3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:33.873955 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:33.874932 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:33.875217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:33.875492 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] PATH_INFO: `/v3/users/b99aca882e1c4a2a8e882447fdc15e4d` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:33.876724 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99aca882e1c4a2a8e882447fdc15e4d)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:33.878685 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:33.931703 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99aca882e1c4a2a8e882447fdc15e4d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.932377 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99aca882e1c4a2a8e882447fdc15e4d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.939416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99aca882e1c4a2a8e882447fdc15e4d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.952061 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99aca882e1c4a2a8e882447fdc15e4d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.958973 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-1d99c705-6f79-4b4d-8df0-874e3529af64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99aca882e1c4a2a8e882447fdc15e4d'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:33.966207 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1405/2818] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 08:56:33 2021] DELETE /identity/v3/users/b99aca882e1c4a2a8e882447fdc15e4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:56:34.156382 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:56:34.157942 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:56:34.178652 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2053b-8e5b-4010-ab08-ffe571f3fe13 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:56:34.242788 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:56:34.243668 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:56:34.243945 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:56:34.244230 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] PATH_INFO: `/v3/projects/f5adad766f6c46a9aecb882bde59675d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:56:34.245702 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5adad766f6c46a9aecb882bde59675d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:56:34.247682 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:56:34.296330 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5adad766f6c46a9aecb882bde59675d', 'request_id': 'req-4c95d595-8881-4c05-90ea-9be258ab7ae1'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:34.302849 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5adad766f6c46a9aecb882bde59675d', 'request_id': 'req-4c95d595-8881-4c05-90ea-9be258ab7ae1'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:34.311840 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5adad766f6c46a9aecb882bde59675d', 'request_id': 'req-4c95d595-8881-4c05-90ea-9be258ab7ae1'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:34.326002 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] The token cache is being invalidate because project f5adad766f6c46a9aecb882bde59675d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79640) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 08:56:34.326250 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:34.326968 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 08:56:34.328783 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1414/2819] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 08:56:34 2021] DELETE /identity/v3/projects/f5adad766f6c46a9aecb882bde59675d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 08:57:42.065934 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:57:42.066935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:57:42.067226 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:57:42.092254 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] MFA Rules not processed for user `d2ef7b4e60214c6c9b5839e9ccfaad4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 08:57:42.095595 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:57:42.160106 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1406/2820] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 08:57:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 08:57:42.534715 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:57:42.536161 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:57:42.595226 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95d595-8881-4c05-90ea-9be258ab7ae1 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:57:42.598976 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:57:42.599733 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:57:42.600057 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:57:42.600358 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:57:42.602255 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:57:42.612866 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:57:42.614315 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:57:42.623022 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1415/2821] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:57:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:57:44.169674 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:57:44.171266 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:57:44.258836 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37394e-4e3a-4102-b2a0-861ad286ff26 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:57:44.264287 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:57:44.264954 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:57:44.265237 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:57:44.265515 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:57:44.267417 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:57:44.279846 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:57:44.281465 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:57:44.300800 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1407/2822] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:57:44 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 08:58:02.103025 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:58:02.104523 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:58:02.213420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1f443-9922-45c7-b51d-1d6c61402a11 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:58:02.219047 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:58:02.219699 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:58:02.219985 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:58:02.220265 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:58:02.222067 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:58:02.234756 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:58:02.236364 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:58:02.246986 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1416/2823] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:58:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 08:58:13.767275 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 08:58:13.778092 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac697c52-69e8-46a1-86c2-d339bd6961fb service placement] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 08:58:13.783251 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 08:58:13.783921 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 08:58:13.784260 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 08:58:13.784487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 08:58:13.786270 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 08:58:13.798487 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 08:58:13.800183 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc3864-0ad1-440a-a73f-d8e1c8f71875 service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 08:58:13.810600 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1408/2824] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 08:58:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:08.216081 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:08.217562 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:08.291570 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e5b87-22d6-4b6b-b712-62d094dc6e03 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:08.295224 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:08.295860 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:08.296144 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:08.296418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:08.298188 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:08.309555 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:08.311035 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:08.319785 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1417/2825] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:08 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:20.318052 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] REQUEST_METHOD: `POST` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:20.318661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:20.318661 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:20.337069 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.auth.core [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] MFA Rules not processed for user `d2ef7b4e60214c6c9b5839e9ccfaad4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:00:20.338299 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:20.346649 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1409/2826] 10.222.0.76 () {58 vars in 957 bytes} [Thu Oct 28 09:00:20 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:00:20.382814 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:20.384217 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:20.396385 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07062de3-8557-47f6-bdac-a80d59e8ab82 service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:20.400095 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64c05096a69740909d10c748be820840', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:20.400734 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:20.401017 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:20.401293 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:20.403102 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:20.417112 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:20.418593 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:20.431220 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1418/2827] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:20.732722 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:20.740551 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c07413-3a34-4723-be64-e3ed3d08a1a2 None None] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:20.744416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:20.745079 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:20.745365 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:20.745644 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:20.747416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:20.758217 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:20.759983 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:20.769032 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1410/2828] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:21.498181 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:21.508911 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57b96d-0fd0-4a13-9064-8fd91cdd638f service cinder] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:21.512501 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:21.513137 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:21.513418 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:21.513694 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:21.515561 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:21.530138 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:21.531637 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:21.544556 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1419/2829] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:39.329351 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:39.330913 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:39.341778 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e150-3b83-47e6-85a0-59807035692f service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:39.346743 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:39.347432 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:39.347715 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:39.347986 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:39.349779 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:39.412958 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:39.414405 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:39.424205 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1411/2830] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:39 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:00:41.083175 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:00:41.095242 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4dd9-96aa-48f8-941e-dec0c56bf419 service neutron] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:00:41.101368 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:00:41.102121 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:00:41.102474 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:00:41.102795 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:00:41.104586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:00:41.118233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:00:41.119956 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:00:41.131251 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1420/2831] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:00:41 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:01:13.490578 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:01:13.499172 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd543-96d7-4c7b-8b25-a4addb738b05 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:01:13.503660 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:01:13.504304 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:01:13.504591 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:01:13.504869 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:01:13.506716 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:01:13.516230 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:01:13.518526 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:01:13.526416 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1412/2832] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:01:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:02:46.727929 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:02:46.741441 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfff124-b3af-4346-802d-40cd227ec16c service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:02:46.749586 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a17f0cdeb07409f8439829dc145d5fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:02:46.750582 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:02:46.751001 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:02:46.751398 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:02:46.756444 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:02:46.771776 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:02:46.773531 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:02:46.785482 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1421/2833] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:02:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:02:56.703114 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:02:56.721956 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00690aac-d4b7-4eff-8d3c-4717e5b2c053 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:02:56.725876 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2d5c942c4e64408b177014981e1e6ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:02:56.726541 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:02:56.726827 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:02:56.727097 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:02:56.728860 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:02:56.820589 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:02:56.822042 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:02:56.831857 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1413/2834] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:02:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:03:03.198661 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:03:03.200154 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:03:03.268319 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c8db-2bb6-4c7c-9493-28f3e17e4036 service nova] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:03:03.275979 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:03:03.277386 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:03:03.277831 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:03:03.278318 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] PATH_INFO: `/v3/users/d2ef7b4e60214c6c9b5839e9ccfaad4d` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:03:03.280273 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ef7b4e60214c6c9b5839e9ccfaad4d)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:03:03.283530 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:03:03.343442 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ef7b4e60214c6c9b5839e9ccfaad4d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.344466 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ef7b4e60214c6c9b5839e9ccfaad4d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.345546 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ef7b4e60214c6c9b5839e9ccfaad4d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.359309 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ef7b4e60214c6c9b5839e9ccfaad4d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.367428 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ef7b4e60214c6c9b5839e9ccfaad4d'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.379520 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1422/2835] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 09:03:03 2021] DELETE /identity/v3/users/d2ef7b4e60214c6c9b5839e9ccfaad4d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:03:03.556004 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:03:03.568389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8f51-45ce-49e0-901e-341797caef81 service neutron] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:03:03.632804 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:03:03.633588 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:03:03.633872 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:03:03.634150 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] PATH_INFO: `/v3/projects/623855e29a5d4365b1dc09eed95a5c8a` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:03:03.635473 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623855e29a5d4365b1dc09eed95a5c8a)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:03:03.637389 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:03:03.684263 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623855e29a5d4365b1dc09eed95a5c8a', 'request_id': 'req-98c7199d-4be7-46e1-912a-5260ceab6aa3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.690424 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623855e29a5d4365b1dc09eed95a5c8a', 'request_id': 'req-98c7199d-4be7-46e1-912a-5260ceab6aa3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.696640 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623855e29a5d4365b1dc09eed95a5c8a', 'request_id': 'req-98c7199d-4be7-46e1-912a-5260ceab6aa3'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.709944 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] The token cache is being invalidate because project 623855e29a5d4365b1dc09eed95a5c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:03:03.710218 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.710895 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.712443 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1414/2836] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 09:03:03 2021] DELETE /identity/v3/projects/623855e29a5d4365b1dc09eed95a5c8a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:03:03.716369 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:03:03.717805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:03:03.730777 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63672c-c779-4fa8-9025-eda1d50f4cc0 admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:03:03.786246 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:03:03.787157 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:03:03.787440 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:03:03.787716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] PATH_INFO: `/v3/users/fd3e43c02e3c40e0bfa57db2abdaddb7` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:03:03.788955 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3e43c02e3c40e0bfa57db2abdaddb7)` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:03:03.790933 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:03:03.838636 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3e43c02e3c40e0bfa57db2abdaddb7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.839301 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3e43c02e3c40e0bfa57db2abdaddb7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.839935 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3e43c02e3c40e0bfa57db2abdaddb7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.852104 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3e43c02e3c40e0bfa57db2abdaddb7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.859716 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.notifications [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3e43c02e3c40e0bfa57db2abdaddb7'} {{(pid=79640) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:03.872728 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1423/2837] 10.222.0.76 () {58 vars in 1223 bytes} [Thu Oct 28 09:03:03 2021] DELETE /identity/v3/users/fd3e43c02e3c40e0bfa57db2abdaddb7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:03:04.040746 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:03:04.042324 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:03:04.057182 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7199d-4be7-46e1-912a-5260ceab6aa3 admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:03:04.121436 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caea61e355e24e9880292252c98a910d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff2c85101aec4012bf80ddd35cbbddef', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:03:04.122334 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:03:04.122656 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:03:04.122935 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] PATH_INFO: `/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:03:04.124136 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae1b8cb4edc4f80b203ed71129ad96e)` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:03:04.126053 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:03:04.172837 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae1b8cb4edc4f80b203ed71129ad96e', 'request_id': 'req-e871f315-5d72-408c-a3c1-bc52ff2508db'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:04.179573 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae1b8cb4edc4f80b203ed71129ad96e', 'request_id': 'req-e871f315-5d72-408c-a3c1-bc52ff2508db'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:04.186457 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae1b8cb4edc4f80b203ed71129ad96e', 'request_id': 'req-e871f315-5d72-408c-a3c1-bc52ff2508db'} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:04.201903 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] The token cache is being invalidate because project 1ae1b8cb4edc4f80b203ed71129ad96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:03:04.202194 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:04.202841 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.notifications [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:03:04.204428 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1415/2838] 10.222.0.76 () {58 vars in 1232 bytes} [Thu Oct 28 09:03:04 2021] DELETE /identity/v3/projects/1ae1b8cb4edc4f80b203ed71129ad96e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:03:20.782421 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Authenticating user token {{(pid=79640) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:03:20.783958 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:03:20.887812 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac04e-ba5e-4ee4-8752-665812f5e6fe admin admin] Validating token access rules against request {{(pid=79640) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:03:20.948133 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79640) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:03:20.948805 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] REQUEST_METHOD: `GET` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:03:20.949233 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] SCRIPT_NAME: `/identity` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:03:20.949553 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79640) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:03:20.952115 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.fernet_utils [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79640) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:03:20.966787 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:03:20.968405 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa67c21-c1ee-4231-beb2-5363ba21b223 service placement] RBAC: Authorization granted {{(pid=79640) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:03:20.982420 dv-cinder-815659-2-iscsi devstack@keystone.service[79640]: [pid: 79640|app: 0|req: 1424/2839] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:03:20 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:08:23.749924 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Authenticating user token {{(pid=79639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:08:23.751692 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.fernet_utils [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:08:23.767295 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871f315-5d72-408c-a3c1-bc52ff2508db admin admin] Validating token access rules against request {{(pid=79639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:08:23.772280 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4a2cc4165da43ac97a20b324eb1d3de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3807df4a12144351ac01f45b9dc31bed', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:08:23.773008 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] REQUEST_METHOD: `GET` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:08:23.773292 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] SCRIPT_NAME: `/identity` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:08:23.773568 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:08:23.782228 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:08:23.784166 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d670-598e-4615-897d-9dda004095b5 service placement] RBAC: Authorization granted {{(pid=79639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:08:23.795262 dv-cinder-815659-2-iscsi devstack@keystone.service[79639]: [pid: 79639|app: 0|req: 1416/2840] 10.222.0.76 () {60 vars in 1365 bytes} [Thu Oct 28 09:08:23 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)